Sep 08 14:53:10.708536 ip-10-0-137-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 14:53:10.708670 ip-10-0-137-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 14:53:10.708766 ip-10-0-137-101 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 14:53:10.709092 ip-10-0-137-101 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 14:53:20.957404 ip-10-0-137-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 14:53:20.957424 ip-10-0-137-101 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 48240aacde1c4d5b9c0e0c15144145ea --
Sep 08 14:55:06.940178 ip-10-0-137-101 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 14:55:07.306790 ip-10-0-137-101 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:55:07.306790 ip-10-0-137-101 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 14:55:07.306790 ip-10-0-137-101 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:55:07.306790 ip-10-0-137-101 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 14:55:07.307561 ip-10-0-137-101 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:55:07.308666 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.308581    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 14:55:07.312219 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312205    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:07.312219 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312219    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312223    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312227    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312230    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312233    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312236    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312239    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312242    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312244    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312248    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312250    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312253    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312256    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312259    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312261    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312264    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312266    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312269    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312272    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:07.312282 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312274    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312276    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312279    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312282    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312284    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312287    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312291    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312295    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312299    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312306    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312309    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312313    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312316    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312319    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312322    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312324    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312327    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312329    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312333    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:07.312743 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312337    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312340    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312343    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312346    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312348    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312351    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312353    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312356    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312359    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312361    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312365    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312368    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312370    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312373    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312375    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312378    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312381    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312383    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312387    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312390    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:07.313261 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312392    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312395    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312398    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312400    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312403    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312405    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312407    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312410    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312413    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312415    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312417    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312420    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312422    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312426    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312429    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312432    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312435    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312438    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312442    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:07.313746 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312444    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312447    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312451    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312454    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312457    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312460    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312463    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312466    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312469    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312471    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312474    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312476    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312479    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312482    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312485    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312487    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312490    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312493    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312495    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312498    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:07.314218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.312501    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313796    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313804    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313807    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313810    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313812    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313816    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313819    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313821    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313824    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313826    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313829    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313832    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313835    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313837    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313861    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313865    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313868    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313870    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313873    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:07.314697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313875    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313878    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313881    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313884    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313886    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313889    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313906    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313908    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313911    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313914    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313916    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313919    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313922    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313924    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313927    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313930    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313932    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313935    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313937    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313940    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:07.315232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313942    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313945    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313947    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313950    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313953    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313957    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313960    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313962    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313965    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313968    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313972    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313974    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313977    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313980    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313983    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313986    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313989    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313991    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313994    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:07.315723 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.313997    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314000    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314002    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314005    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314007    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314010    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314013    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314016    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314018    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314021    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314024    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314026    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314029    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314031    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314034    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314038    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314040    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314042    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314045    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:07.316211 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314047    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314050    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314053    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314056    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314059    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314062    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314064    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314067    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314069    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314072    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314074    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314077    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314079    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314082    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314086    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314089    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314092    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314095    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314100    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:07.316687 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314102    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314105    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314109    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314458    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314463    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314468    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314471    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314475    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314478    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314481    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314484    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314486    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314489    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314492    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314494    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314497    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314503    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314505    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314508    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:07.317165 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314511    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314513    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314515    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314518    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314520    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314523    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314525    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314528    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314530    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314533    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314535    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314538    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314541    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314544    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314546    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314549    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314551    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314554    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314556    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314559    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:07.317651 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314562    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314564    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314568    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314571    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314574    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314577    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314579    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314582    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314584    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314587    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314590    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314592    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314595    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314598    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314600    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314603    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314605    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314608    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314611    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:07.318163 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314613    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314616    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314618    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314620    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314623    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314625    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314629    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314631    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314634    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314636    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314639    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314642    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314644    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314647    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314649    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314652    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314654    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314657    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314661    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314664    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:07.318649 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314666    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314669    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314673    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314676    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314678    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314681    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314684    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314686    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314689    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314691    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314694    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314696    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314699    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314702    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314704    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314707    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314710    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314712    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314716    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314719    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:07.319152 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314721    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314724    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314726    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.314729    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314804    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314838    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314844    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314848    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314852    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314856    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314860    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314864    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314867    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314869    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314872    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314876    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314879    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314882    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314885    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314888    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314905    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314911    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314916    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 08 14:55:07.319674 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314921    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314924    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314927    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314931    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314935    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314938    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314941    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314944    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314947    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314950    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314953    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314956    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314959    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314962    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314965    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314968    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314971    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314974    2579 flags.go:64] FLAG: --enable-server="true"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314978    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314983    2579 flags.go:64] FLAG: --event-burst="100"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314986    2579 flags.go:64] FLAG: --event-qps="50"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314989    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314991    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314994    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 08 14:55:07.320312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.314998    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315001    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315004    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315007    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315010    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315013    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315015    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315018    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315021    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315024    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315026    2579 flags.go:64] FLAG: --feature-gates=""
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315030    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315033    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315035    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315038    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315041    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315044    2579 flags.go:64] FLAG: --help="false"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315047    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315050    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315053    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315056    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315059    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315062    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315065    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 14:55:07.320881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315068    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315071    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315075    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315078    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315081    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315084    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315086    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315089    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315092    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315095    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315098    2579 flags.go:64] FLAG: --lock-file=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315100    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315104    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315107    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315112    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315114    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315117    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315120    2579 flags.go:64] FLAG: --logging-format="text"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315123    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315126    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315128    2579 flags.go:64] FLAG: --manifest-url=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315131    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315135    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315138    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315142    2579 flags.go:64] FLAG: --max-pods="110"
Sep 08 14:55:07.321518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315145    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315147    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315150    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315153    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315156    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315159    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315162    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315168    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315171    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315176    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315179    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315182    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315187    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315190    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315193    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315196    2579 flags.go:64] FLAG: --port="10250"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315199    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315201    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042ced05f229e0724"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315204    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315207    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315210    2579 flags.go:64] FLAG: --register-node="true"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315213    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315217    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315220    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 08 14:55:07.322168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315222    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315225    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315228    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315231    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315234    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315237    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315241    2579 flags.go:64] FLAG: --runonce="false"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315244    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315247    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315250    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315253    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315256    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315259    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315262    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315265    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315268    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315271    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315275    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315278    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315281    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315284    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315286    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315292    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315308    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315312    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 14:55:07.322763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315316    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315319    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315322    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315325    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315329    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315332    2579 flags.go:64] FLAG: --v="2"
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315341    2579 flags.go:64] FLAG: --version="false"
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315345    2579 flags.go:64] FLAG: --vmodule=""
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315349    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.315352    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315458    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315462    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315467    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315470    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315473    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315476    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315479    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315482    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315485    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315488    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315491    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315494    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:07.323398 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315497    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315500    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315504    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315507    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315509    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315512    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315514    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315517    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315520    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315522    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315525    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315527    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315530    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315533    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315535    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315538    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315541    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315543    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315546    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315548    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:07.323985 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315551    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315554    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315558    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315560    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315563    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315566    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315568    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315571    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315573    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315575    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315578    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315582    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315585    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315588    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315594    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315597    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315600    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315603    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315606    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:07.324556 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315609    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315612    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315615    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315625    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315628    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315631    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315635    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315638    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315641    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315644    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315647    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315650    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315653    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315655    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315658    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315662    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315664    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315667    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315670    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:07.325042 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315672    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315675    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315677    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315680    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315683    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315685    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315688    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315690    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315694    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315697    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315699    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315702    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315705    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315707    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315710    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315712    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315715    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315717    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315721    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:07.325505 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315725    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315728    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315731    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315733    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315737    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315739    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315742    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315745    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315747    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.315751    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.316350    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.323552    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.323565    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.323580    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.323585    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 14:55:07.326001 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323645    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323649    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323652    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323655    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323659    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323661    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323665    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323668    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323671    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323674    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323677    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323679    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323682    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323685    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323688    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323690    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323693    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323696    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323698    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:07.326367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323701    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323703    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323706    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323709    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323712    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323714    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323716    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323719    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323724    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323727    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323731    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323733    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323736    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323739    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323742    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323744    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323747    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323750    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323752    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:07.326818 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323755    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323758    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323760    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323763    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323765    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323768    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323770    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323773    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323775    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323778    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323780    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323783    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323786    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323789    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323791    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323794    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323797    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323800    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323802    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323805    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:07.327327 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323807    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323810    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323813    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323815    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323818    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323820    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323822    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323825    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323828    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323830    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323833    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323835    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323838    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323841    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323844    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323847    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323850    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323853    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323855    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:07.327817 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323858    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323860    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323863    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323865    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323868    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323871    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323875    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323878    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323881    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323884    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323887    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323903    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323907    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323910    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323913    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323917    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323919    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323922    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323925    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323928    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:07.328353 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323930    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.323933    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.323938    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324074    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324078    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324082    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324085    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324087    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324090    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324093    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324095    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324098    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324101    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324103    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324106    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:55:07.328844 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324108    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324111    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324114    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324116    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324119    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324121    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324124    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324126    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324134    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324137    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324140    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324142    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324145    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324147    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324150    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324153    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324155    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324157    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324160    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324162    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:55:07.329224 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324165    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324167    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324170    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324173    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324175    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324178    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324180    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324183    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324185    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324188    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324190    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324192    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324195    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324197    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324200    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324202    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324205    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324207    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324211    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:55:07.329701 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324214    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324217    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324230    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324233    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324236    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324239    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324242    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324245    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324248    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324250    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324253    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324255    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324258    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324260    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324263    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324265    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324268    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324270    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324273    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324275    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:55:07.330184 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324278    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324281    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324283    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324285    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324288    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324291    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324293    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324295    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324298    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324300    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324303    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324305    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324308    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324310    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324314    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324322    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324325    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324327    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324330    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:55:07.330667 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324333    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324335    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324338    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324340    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324343    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324345    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324348    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324350    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:07.324353    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.324358    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.324463    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.326772    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.327526    2579 server.go:1019] "Starting client certificate rotation"
Sep 08 14:55:07.331143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.327646    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:55:07.331470 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.327687    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:55:07.331470 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.330131    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:55:07.331972 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.331925    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:55:07.342763 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.342743    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 08 14:55:07.347815 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.347798    2579 log.go:25] "Validated CRI v1 image API"
Sep 08 14:55:07.348634 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.348618    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 14:55:07.351998 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.351973    2579 fs.go:135] Filesystem UUIDs: map[4288955e-bb5f-408a-a80d-e6b765ec96c8:/dev/nvme0n1p4 5885ef11-8535-47a5-987f-b2d492eb4f3f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 08 14:55:07.352083 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.351996    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 14:55:07.357589 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.357468    2579 manager.go:216] Machine: {Timestamp:2026-09-08 14:55:07.355635918 +0000 UTC m=+0.309211469 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3057578 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24e1d10a644bec2569cf83f350c994 SystemUUID:ec24e1d1-0a64-4bec-2569-cf83f350c994 BootID:48240aac-de1c-4d5b-9c0e-0c15144145ea Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:f0:90:9c:61 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:f0:90:9c:61 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:d1:3a:36:09:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 14:55:07.357589 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.357569    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 14:55:07.357741 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.357672    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 14:55:07.359593 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.359577    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:55:07.360509 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.360486    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 14:55:07.360632 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.360513    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 14:55:07.361834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.361823    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 14:55:07.361834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.361835    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 14:55:07.361932 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.361842    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:55:07.361932 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.361860    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:55:07.363018 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.363008    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 14:55:07.366989 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.366978    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:55:07.367099 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367090    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 14:55:07.367139 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367118    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 14:55:07.367139 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367127    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 14:55:07.367203 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367140    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 14:55:07.367203 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367150    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 08 14:55:07.367203 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367159    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 14:55:07.367543 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367529    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:55:07.367597 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.367558    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:55:07.369689 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.369664    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 14:55:07.372324 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.372311    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 14:55:07.372369 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.372341    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 14:55:07.373807 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373795    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 14:55:07.373846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373813    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 14:55:07.373846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373819    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 14:55:07.373846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373825    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 14:55:07.373846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373834    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 14:55:07.373846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373839    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 14:55:07.374004 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373852    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 14:55:07.374004 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373857    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 14:55:07.374004 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373864    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 14:55:07.374004 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373869    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 14:55:07.374004 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373881    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 14:55:07.374004 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.373886    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 14:55:07.374604 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.374589    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 14:55:07.374666 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.374609    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 14:55:07.378030 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.378015    2579 server.go:1268] "Started kubelet"
Sep 08 14:55:07.378125 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.378075    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 14:55:07.378826 ip-10-0-137-101 systemd[1]: Started Kubernetes Kubelet.
Sep 08 14:55:07.379023 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.378935    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 14:55:07.379023 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.379021    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 14:55:07.380067 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.380040    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 14:55:07.380167 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.380135    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 14:55:07.380601 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.380113    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 14:55:07.380656 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.380626    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 14:55:07.382181 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.382112    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 14:55:07.387092 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.383529    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d360408e4fc4da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.37798473 +0000 UTC m=+0.331560281,LastTimestamp:2026-09-08 14:55:07.37798473 +0000 UTC m=+0.331560281,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.387213 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.387129    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 14:55:07.388780 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.388759    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 14:55:07.388780 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.388763    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 14:55:07.388935 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.388857    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:07.389495 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389471    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 14:55:07.389495 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389485    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 14:55:07.389619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389519    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 14:55:07.389619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389585    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 14:55:07.389619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389594    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 14:55:07.389619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389607    2579 factory.go:55] Registering systemd factory
Sep 08 14:55:07.389619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389622    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 08 14:55:07.389858 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389845    2579 factory.go:153] Registering CRI-O factory
Sep 08 14:55:07.389930 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389863    2579 factory.go:223] Registration of the crio container factory successfully
Sep 08 14:55:07.389963 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389933    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 14:55:07.389963 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389954    2579 factory.go:103] Registering Raw factory
Sep 08 14:55:07.390036 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.389968    2579 manager.go:1196] Started watching for new ooms in manager
Sep 08 14:55:07.390358 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.390346    2579 manager.go:349] Starting recovery of all containers
Sep 08 14:55:07.397670 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.397621    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 14:55:07.398467 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.398437    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 14:55:07.398570 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.398546    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 14:55:07.398651 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.398636    2579 manager.go:354] Recovery completed
Sep 08 14:55:07.405270 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.405258    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.406959 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.406929    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.407020 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.406971    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.407020 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.406988    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.407482 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.407466    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 14:55:07.407482 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.407475    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.407482 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.407480    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 14:55:07.407654 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.407496    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:55:07.408231 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408213    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.408302 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408244    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.408302 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408264    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.408577 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408560    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n6g2b"
Sep 08 14:55:07.408683 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408672    2579 policy_none.go:49] "None policy: Start"
Sep 08 14:55:07.408745 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408690    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 14:55:07.408745 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.408703    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 14:55:07.409333 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.409262    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d360409009db1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406957341 +0000 UTC m=+0.360532893,LastTimestamp:2026-09-08 14:55:07.406957341 +0000 UTC m=+0.360532893,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.409857 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.409841    2579 policy_none.go:47] "Start"
Sep 08 14:55:07.418529 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.418352    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d36040900a29ab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406977451 +0000 UTC m=+0.360553004,LastTimestamp:2026-09-08 14:55:07.406977451 +0000 UTC m=+0.360553004,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.418735 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.418720    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-n6g2b"
Sep 08 14:55:07.427695 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.427633    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d36040900a6c8e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406994574 +0000 UTC m=+0.360570134,LastTimestamp:2026-09-08 14:55:07.406994574 +0000 UTC m=+0.360570134,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.437073 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437059    2579 manager.go:337] "Starting Device Plugin manager"
Sep 08 14:55:07.437143 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.437095    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 14:55:07.437143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437108    2579 server.go:87] "Starting device plugin registration server"
Sep 08 14:55:07.437417 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437398    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 14:55:07.437507 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437416    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 14:55:07.437644 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437628    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 14:55:07.437734 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437695    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 14:55:07.437734 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.437703    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 14:55:07.438223 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.438207    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 14:55:07.438302 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.438253    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:07.439043 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.438977    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-101.ec2.internal.18d360409009db1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d360409009db1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406957341 +0000 UTC m=+0.360532893,LastTimestamp:2026-09-08 14:55:07.408230775 +0000 UTC m=+0.361806329,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.450174 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.450115    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-101.ec2.internal.18d36040900a29ab\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d36040900a29ab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406977451 +0000 UTC m=+0.360553004,LastTimestamp:2026-09-08 14:55:07.408250776 +0000 UTC m=+0.361826328,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.458070 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.457995    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-101.ec2.internal.18d36040900a6c8e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d36040900a6c8e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406994574 +0000 UTC m=+0.360570134,LastTimestamp:2026-09-08 14:55:07.408270178 +0000 UTC m=+0.361845729,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.468467 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.468402    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d3604092ce699c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.453393308 +0000 UTC m=+0.406968847,LastTimestamp:2026-09-08 14:55:07.453393308 +0000 UTC m=+0.406968847,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.537755 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.537723    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.538576 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.538562    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.538657 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.538591    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.538657 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.538606    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.538657 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.538633    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.547322 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.547253    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-101.ec2.internal.18d360409009db1d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d360409009db1d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406957341 +0000 UTC m=+0.360532893,LastTimestamp:2026-09-08 14:55:07.538576098 +0000 UTC m=+0.492151648,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.556110 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.556033    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-101.ec2.internal.18d36040900a29ab\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18d36040900a29ab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-101.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-09-08 14:55:07.406977451 +0000 UTC m=+0.360553004,LastTimestamp:2026-09-08 14:55:07.538598242 +0000 UTC m=+0.492173794,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}"
Sep 08 14:55:07.556190 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.556156    2579 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-137-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"nodes\" in API group \"\" at the cluster scope" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.574770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.574753    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 14:55:07.575795 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.574797    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 14:55:07.575795 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.574815    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 14:55:07.575795 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.574873    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 14:55:07.576992 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.576971    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:07.604549 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.604531    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-101.ec2.internal\" not found" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.675677 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.675652    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"]
Sep 08 14:55:07.675753 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.675724    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.676411 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.676397    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.676493 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.676421    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.676493 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.676433    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.677677 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.677665    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.677796 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.677783    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.677850 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.677816    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.678311 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.678297    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.678311 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.678309    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.678390 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.678322    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.678390 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.678327    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.678390 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.678335    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.678473 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.678337    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.679689 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.679673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.679806 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.679696    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.680335 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.680311    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.680335 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.680335    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.680468 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.680348    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.691543 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.691524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2693b87bf16c7efe119dacfb165b17ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"2693b87bf16c7efe119dacfb165b17ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.691618 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.691551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2693b87bf16c7efe119dacfb165b17ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"2693b87bf16c7efe119dacfb165b17ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.691618 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.691567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0167a65271ebed0b746181fb3621931d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-101.ec2.internal\" (UID: \"0167a65271ebed0b746181fb3621931d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.703446 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.703424    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-101.ec2.internal\" not found" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.707665 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.707650    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-101.ec2.internal\" not found" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.756445 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.756425    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:07.757093 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.757079    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:07.757182 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.757101    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:07.757182 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.757112    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:07.757182 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.757139    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.768184 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.768169    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.768255 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.768188    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-101.ec2.internal\": node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:07.792667 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.792651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2693b87bf16c7efe119dacfb165b17ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"2693b87bf16c7efe119dacfb165b17ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.792758 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.792673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2693b87bf16c7efe119dacfb165b17ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"2693b87bf16c7efe119dacfb165b17ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.792758 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.792688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0167a65271ebed0b746181fb3621931d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-101.ec2.internal\" (UID: \"0167a65271ebed0b746181fb3621931d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.792758 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.792712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0167a65271ebed0b746181fb3621931d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-101.ec2.internal\" (UID: \"0167a65271ebed0b746181fb3621931d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.792758 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.792748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2693b87bf16c7efe119dacfb165b17ef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"2693b87bf16c7efe119dacfb165b17ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.792758 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:07.792748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2693b87bf16c7efe119dacfb165b17ef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"2693b87bf16c7efe119dacfb165b17ef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:07.794796 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.794780    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:07.895622 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.895582    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:07.996054 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:07.996037    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:08.007191 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:08.007176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:08.013350 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:08.013335    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:08.097039 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:08.097018    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:08.197616 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:08.197565    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:08.298094 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:08.298062    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:08.322523 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:08.322502    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:08.328148 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:08.328130    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 14:55:08.328264 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:08.328245    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:55:08.328328 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:08.328304    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:55:08.398998 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:08.398972    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:10.229866 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.229852    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:55:10.230791 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.230776    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:55:10.230862 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.230803    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:55:10.230862 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.230815    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:55:10.305637 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:10.305587    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:10.308126 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.308111    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:10.364799 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.364755    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 14:50:09 +0000 UTC" deadline="2028-02-18 08:43:09.009263363 +0000 UTC"
Sep 08 14:55:10.364799 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.364791    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12665h47m58.644474705s"
Sep 08 14:55:10.406122 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:10.406103    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:10.506627 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:10.506597    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:10.537218 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:10.537191    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0167a65271ebed0b746181fb3621931d.slice/crio-8fc73f7a29d3ebc84b80cf8d181c95776ac4d874966a7744462a2c19b3497328 WatchSource:0}: Error finding container 8fc73f7a29d3ebc84b80cf8d181c95776ac4d874966a7744462a2c19b3497328: Status 404 returned error can't find the container with id 8fc73f7a29d3ebc84b80cf8d181c95776ac4d874966a7744462a2c19b3497328
Sep 08 14:55:10.537787 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:10.537757    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2693b87bf16c7efe119dacfb165b17ef.slice/crio-73815a883bc006fea446e1beadf06fb1de519f780a063edfc7f51e49e846b051 WatchSource:0}: Error finding container 73815a883bc006fea446e1beadf06fb1de519f780a063edfc7f51e49e846b051: Status 404 returned error can't find the container with id 73815a883bc006fea446e1beadf06fb1de519f780a063edfc7f51e49e846b051
Sep 08 14:55:10.542625 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.542609    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:55:10.607743 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:10.607688    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found"
Sep 08 14:55:10.622455 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.622437    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:10.696513 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.696489    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:10.708688 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.708671    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:55:10.709728 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.709712    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"
Sep 08 14:55:10.718133 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:10.718119    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:55:11.174178 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.174156    2579 apiserver.go:52] "Watching apiserver"
Sep 08 14:55:11.181067 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.181046    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 14:55:11.182519 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.182488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-phr6j","kube-system/konnectivity-agent-qgt4k","kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688","openshift-cluster-node-tuning-operator/tuned-zbhnp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-xgxjn","openshift-multus/network-metrics-daemon-nv6hp","kube-system/global-pull-secret-syncer-lfnx7","openshift-dns/node-resolver-g4pjk","openshift-image-registry/node-ca-hpggd","openshift-multus/multus-m9ss5","openshift-network-diagnostics/network-check-target-phsbw","openshift-network-operator/iptables-alerter-k7vrt"]
Sep 08 14:55:11.184091 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.184072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.185265    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.185694    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.186487    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rr2gz\""
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.186602    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.186687    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.186849    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.187602    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.187822    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 14:55:11.188011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.187966    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.190152 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.190136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.191025 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.191006    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.191122 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.191106    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjnkr\""
Sep 08 14:55:11.191186 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.191122    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 14:55:11.191256 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.191239    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.191762 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.191734    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.192231 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.192211    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.192349 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.192211    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 14:55:11.192412 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.192389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wv8vg\""
Sep 08 14:55:11.192486 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.192432    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.193145 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.193128    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.193239 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.193218    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:11.194580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.194467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.194580 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.194524    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:11.194973 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.194947    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.195040 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.195018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.195245 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.195230    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2rs6k\""
Sep 08 14:55:11.195866 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.195848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.196395 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.196376    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 14:55:11.196395 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.196398    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:11.197321 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.197303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.198479 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.198460    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.198479 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.198475    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 14:55:11.198617 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.198519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 14:55:11.198671 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.198647    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 14:55:11.198904 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.198875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.199007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.198990    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.199290 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.199274    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2s8xj\""
Sep 08 14:55:11.199351 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.199281    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 14:55:11.199403 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.199389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 14:55:11.199643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.199625    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 14:55:11.199724 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.199709    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cp9q7\""
Sep 08 14:55:11.200267 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.200249    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.201047 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.201019    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xp7gz\""
Sep 08 14:55:11.201126 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.201064    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.201382 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.201345    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.202126 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.202107    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.202353 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.202332    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 14:55:11.202459 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.202429    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lxfsf\""
Sep 08 14:55:11.202650 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.202629    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 14:55:11.202744 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.202692    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 14:55:11.204218 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.204174    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 14:55:11.204379 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.204360    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rbfbn\""
Sep 08 14:55:11.208533 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cni-binary-copy\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.208623 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-iptables-alerter-script\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.208623 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-socket-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.208623 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208581    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-device-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.208759 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kphpf\" (UniqueName: \"kubernetes.io/projected/bac42b22-c174-4326-9688-fd2863e36f04-kube-api-access-kphpf\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.208759 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208665    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.208864 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-kubelet\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.208864 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-run-netns\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.208864 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-systemd\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208871    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-var-lib-kubelet\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cnibin\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.209007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.209007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.209007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.208968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-systemd\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-node-log\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-cni-bin\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk2ss\" (UniqueName: \"kubernetes.io/projected/f6af87d0-16d9-4d89-9706-f9ac2bad3561-kube-api-access-fk2ss\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-registration-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-sys-fs\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.209211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-host\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bac42b22-c174-4326-9688-fd2863e36f04-tmp\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-cni-netd\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-lib-modules\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/beed6b1a-f32d-44f6-83fc-bbd04306be8c-kubelet-config\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-system-cni-dir\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209412    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysconfig\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209440    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysctl-conf\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84kjh\" (UniqueName: \"kubernetes.io/projected/73807993-fc1d-4a2d-8e47-dcbed1d89e19-kube-api-access-84kjh\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xhj\" (UniqueName: \"kubernetes.io/projected/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-kube-api-access-n7xhj\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysctl-d\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.209598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-sys\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209626    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bac42b22-c174-4326-9688-fd2863e36f04-etc-tuned\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovn-node-metrics-cert\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-kubernetes\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-ovn\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-host-slash\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209788    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-slash\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209828    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-var-lib-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-run-ovn-kubernetes\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209957    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovnkube-config\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.209979    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89d5f41d-90c3-4008-8a33-838cd3330379-agent-certs\") pod \"konnectivity-agent-qgt4k\" (UID: \"89d5f41d-90c3-4008-8a33-838cd3330379\") " pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89d5f41d-90c3-4008-8a33-838cd3330379-konnectivity-ca\") pod \"konnectivity-agent-qgt4k\" (UID: \"89d5f41d-90c3-4008-8a33-838cd3330379\") " pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-run\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.210327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-env-overrides\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210067    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8r2w\" (UniqueName: \"kubernetes.io/projected/1fc94e5d-448a-4945-ae24-71f5170e623a-kube-api-access-n8r2w\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bfx2\" (UniqueName: \"kubernetes.io/projected/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-kube-api-access-4bfx2\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210140    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-systemd-units\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210163    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-log-socket\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovnkube-script-lib\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-modprobe-d\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210245    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/beed6b1a-f32d-44f6-83fc-bbd04306be8c-dbus\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.210911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.210279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-etc-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.213822 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.213794    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:55:11.231598 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.231577    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mcnh4"
Sep 08 14:55:11.237498 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.237480    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mcnh4"
Sep 08 14:55:11.297709 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.297685    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 14:55:11.310630 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-host-slash\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.310630 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-slash\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.310783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-var-lib-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.310783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.310783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310716    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-host-slash\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.310783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-var-lib-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.310783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-slash\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.310783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-run-ovn-kubernetes\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-cni-binary-copy\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310837    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-run-ovn-kubernetes\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310854    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovnkube-config\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89d5f41d-90c3-4008-8a33-838cd3330379-agent-certs\") pod \"konnectivity-agent-qgt4k\" (UID: \"89d5f41d-90c3-4008-8a33-838cd3330379\") " pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310929    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89d5f41d-90c3-4008-8a33-838cd3330379-konnectivity-ca\") pod \"konnectivity-agent-qgt4k\" (UID: \"89d5f41d-90c3-4008-8a33-838cd3330379\") " pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310952    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-cni-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310973    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-cni-multus\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.311008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.310995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-run\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-run\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-env-overrides\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311119    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8r2w\" (UniqueName: \"kubernetes.io/projected/1fc94e5d-448a-4945-ae24-71f5170e623a-kube-api-access-n8r2w\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bfx2\" (UniqueName: \"kubernetes.io/projected/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-kube-api-access-4bfx2\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311165    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-systemd-units\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-log-socket\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovnkube-script-lib\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c2932f0-81e5-4cea-812f-122a0cea9375-serviceca\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311272    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-modprobe-d\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/beed6b1a-f32d-44f6-83fc-bbd04306be8c-dbus\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.311330 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311320    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-etc-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-kubelet\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cni-binary-copy\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311393    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-iptables-alerter-script\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311418    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-socket-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311422    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-device-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311516    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kphpf\" (UniqueName: \"kubernetes.io/projected/bac42b22-c174-4326-9688-fd2863e36f04-kube-api-access-kphpf\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgwnk\" (UniqueName: \"kubernetes.io/projected/1c2932f0-81e5-4cea-812f-122a0cea9375-kube-api-access-zgwnk\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-etc-openvswitch\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311570    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-hostroot\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311595    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-kubelet\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/beed6b1a-f32d-44f6-83fc-bbd04306be8c-dbus\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovnkube-config\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311647    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-run-netns\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.311802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89d5f41d-90c3-4008-8a33-838cd3330379-konnectivity-ca\") pod \"konnectivity-agent-qgt4k\" (UID: \"89d5f41d-90c3-4008-8a33-838cd3330379\") " pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-device-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-netns\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-systemd\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311826    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-systemd\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311833    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-modprobe-d\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-run-netns\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovnkube-script-lib\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.311948    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.311968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-log-socket\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312005    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-kubelet\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.312027    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:55:11.811987863 +0000 UTC m=+2.959008766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312046    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-var-lib-kubelet\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312052    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-systemd-units\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-k8s-cni-cncf-io\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cnibin\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cni-binary-copy\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.312553 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-var-lib-kubelet\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312185    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-cnibin\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312222    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-systemd\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312266    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-socket-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-node-log\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-systemd\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312318    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-cni-bin\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-cni-bin\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312372    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-node-log\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-iptables-alerter-script\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk2ss\" (UniqueName: \"kubernetes.io/projected/f6af87d0-16d9-4d89-9706-f9ac2bad3561-kube-api-access-fk2ss\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-registration-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-cni-bin\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-sys-fs\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-registration-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.313251 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312520    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-env-overrides\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312564    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-sys-fs\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.312585    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6af87d0-16d9-4d89-9706-f9ac2bad3561-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312682    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c2932f0-81e5-4cea-812f-122a0cea9375-host\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.312711    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:11.812693815 +0000 UTC m=+2.959714706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-multus-certs\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312770    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bghvz\" (UniqueName: \"kubernetes.io/projected/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-kube-api-access-bghvz\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-host\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bac42b22-c174-4326-9688-fd2863e36f04-tmp\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-etc-selinux\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312850    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-cni-netd\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-host\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-socket-dir-parent\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.314011 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312928    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-daemon-config\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-cni-netd\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-lib-modules\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.312976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/beed6b1a-f32d-44f6-83fc-bbd04306be8c-kubelet-config\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4vg\" (UniqueName: \"kubernetes.io/projected/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-kube-api-access-8b4vg\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313025    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-system-cni-dir\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-lib-modules\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/beed6b1a-f32d-44f6-83fc-bbd04306be8c-kubelet-config\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73807993-fc1d-4a2d-8e47-dcbed1d89e19-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysconfig\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313123    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6af87d0-16d9-4d89-9706-f9ac2bad3561-system-cni-dir\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysconfig\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysctl-conf\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-cnibin\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313190    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-tmp-dir\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84kjh\" (UniqueName: \"kubernetes.io/projected/73807993-fc1d-4a2d-8e47-dcbed1d89e19-kube-api-access-84kjh\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.314843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xhj\" (UniqueName: \"kubernetes.io/projected/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-kube-api-access-n7xhj\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysctl-d\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313280    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313287    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-sys\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysctl-conf\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313315    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bac42b22-c174-4326-9688-fd2863e36f04-etc-tuned\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovn-node-metrics-cert\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313341    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-sys\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-etc-kubernetes\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313378    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-kubernetes\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313392    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-sysctl-d\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313398    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-ovn\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-system-cni-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313439    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-conf-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-hosts-file\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:11.315705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bac42b22-c174-4326-9688-fd2863e36f04-etc-kubernetes\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.316371 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.313629    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-run-ovn\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.316371 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.315998    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bac42b22-c174-4326-9688-fd2863e36f04-tmp\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.316371 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.316025    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bac42b22-c174-4326-9688-fd2863e36f04-etc-tuned\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.316371 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.316127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-ovn-node-metrics-cert\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.316563 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.316376    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89d5f41d-90c3-4008-8a33-838cd3330379-agent-certs\") pod \"konnectivity-agent-qgt4k\" (UID: \"89d5f41d-90c3-4008-8a33-838cd3330379\") " pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.319634 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.319540    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:11.319634 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.319563    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:11.319634 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.319576    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pb6lc for pod openshift-network-diagnostics/network-check-target-phsbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:11.319834 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.319659    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc podName:7a8f1386-02f6-4b25-94b2-b8ae737c32a7 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:11.819632076 +0000 UTC m=+2.966652970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pb6lc" (UniqueName: "kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc") pod "network-check-target-phsbw" (UID: "7a8f1386-02f6-4b25-94b2-b8ae737c32a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:11.321662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.321636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bfx2\" (UniqueName: \"kubernetes.io/projected/c0b6294c-5ea5-4d3e-97d5-1b34d130dad6-kube-api-access-4bfx2\") pod \"iptables-alerter-k7vrt\" (UID: \"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6\") " pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.322278 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.322243    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk2ss\" (UniqueName: \"kubernetes.io/projected/f6af87d0-16d9-4d89-9706-f9ac2bad3561-kube-api-access-fk2ss\") pod \"multus-additional-cni-plugins-xgxjn\" (UID: \"f6af87d0-16d9-4d89-9706-f9ac2bad3561\") " pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.322557 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.322541    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8r2w\" (UniqueName: \"kubernetes.io/projected/1fc94e5d-448a-4945-ae24-71f5170e623a-kube-api-access-n8r2w\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.322663 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.322646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xhj\" (UniqueName: \"kubernetes.io/projected/7fb43d0e-8f1b-4d10-981c-122ed0eeaea2-kube-api-access-n7xhj\") pod \"ovnkube-node-phr6j\" (UID: \"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2\") " pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.323305 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.323283    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kphpf\" (UniqueName: \"kubernetes.io/projected/bac42b22-c174-4326-9688-fd2863e36f04-kube-api-access-kphpf\") pod \"tuned-zbhnp\" (UID: \"bac42b22-c174-4326-9688-fd2863e36f04\") " pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.323380 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.323327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84kjh\" (UniqueName: \"kubernetes.io/projected/73807993-fc1d-4a2d-8e47-dcbed1d89e19-kube-api-access-84kjh\") pod \"aws-ebs-csi-driver-node-pf688\" (UID: \"73807993-fc1d-4a2d-8e47-dcbed1d89e19\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.386397 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.386336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" event={"ID":"0167a65271ebed0b746181fb3621931d","Type":"ContainerStarted","Data":"8fc73f7a29d3ebc84b80cf8d181c95776ac4d874966a7744462a2c19b3497328"}
Sep 08 14:55:11.387697 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.387675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"2693b87bf16c7efe119dacfb165b17ef","Type":"ContainerStarted","Data":"73815a883bc006fea446e1beadf06fb1de519f780a063edfc7f51e49e846b051"}
Sep 08 14:55:11.414329 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414306    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4vg\" (UniqueName: \"kubernetes.io/projected/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-kube-api-access-8b4vg\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414436 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-cnibin\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414436 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-tmp-dir\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.414436 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-etc-kubernetes\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414436 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-system-cni-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-conf-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-hosts-file\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414517    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-cnibin\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-cni-binary-copy\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-system-cni-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-etc-kubernetes\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414585    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-conf-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414662 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-hosts-file\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-cni-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-cni-dir\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414749    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-cni-multus\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c2932f0-81e5-4cea-812f-122a0cea9375-serviceca\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414812    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-kubelet\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414832    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-cni-multus\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgwnk\" (UniqueName: \"kubernetes.io/projected/1c2932f0-81e5-4cea-812f-122a0cea9375-kube-api-access-zgwnk\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414875    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-hostroot\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-netns\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414944    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-k8s-cni-cncf-io\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-kubelet\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.414971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.414971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-cni-bin\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415008    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c2932f0-81e5-4cea-812f-122a0cea9375-host\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415007    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-netns\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-multus-certs\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415038    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-cni-binary-copy\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bghvz\" (UniqueName: \"kubernetes.io/projected/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-kube-api-access-bghvz\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-var-lib-cni-bin\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415058    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-hostroot\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1c2932f0-81e5-4cea-812f-122a0cea9375-host\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-socket-dir-parent\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-k8s-cni-cncf-io\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415181    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-host-run-multus-certs\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-daemon-config\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-socket-dir-parent\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415212    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1c2932f0-81e5-4cea-812f-122a0cea9375-serviceca\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.415580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-tmp-dir\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.416196 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.415646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-multus-daemon-config\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.426341 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.426286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4vg\" (UniqueName: \"kubernetes.io/projected/2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15-kube-api-access-8b4vg\") pod \"multus-m9ss5\" (UID: \"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15\") " pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.427224 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.427194    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bghvz\" (UniqueName: \"kubernetes.io/projected/4358d9ec-fe9c-4e92-9ec0-84c7bf057cac-kube-api-access-bghvz\") pod \"node-resolver-g4pjk\" (UID: \"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac\") " pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.427298 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.427287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgwnk\" (UniqueName: \"kubernetes.io/projected/1c2932f0-81e5-4cea-812f-122a0cea9375-kube-api-access-zgwnk\") pod \"node-ca-hpggd\" (UID: \"1c2932f0-81e5-4cea-812f-122a0cea9375\") " pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.497213 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.497187    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xgxjn"
Sep 08 14:55:11.505742 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.505722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k7vrt"
Sep 08 14:55:11.514400 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:11.514359    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0b6294c_5ea5_4d3e_97d5_1b34d130dad6.slice/crio-c0857950d1ce7f231a4affd04550c56e293dc2e0f1f24bf1c1349005adb4ab8e WatchSource:0}: Error finding container c0857950d1ce7f231a4affd04550c56e293dc2e0f1f24bf1c1349005adb4ab8e: Status 404 returned error can't find the container with id c0857950d1ce7f231a4affd04550c56e293dc2e0f1f24bf1c1349005adb4ab8e
Sep 08 14:55:11.516703 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.516681    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688"
Sep 08 14:55:11.521303 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.521283    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zbhnp"
Sep 08 14:55:11.525697 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:11.525667    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73807993_fc1d_4a2d_8e47_dcbed1d89e19.slice/crio-40c3e7ff3de58b0cd45603300bc861eb462b15e4cca500f2c7b7a1a3e992ccfc WatchSource:0}: Error finding container 40c3e7ff3de58b0cd45603300bc861eb462b15e4cca500f2c7b7a1a3e992ccfc: Status 404 returned error can't find the container with id 40c3e7ff3de58b0cd45603300bc861eb462b15e4cca500f2c7b7a1a3e992ccfc
Sep 08 14:55:11.526612 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.526438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:11.532367 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:11.532141    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbac42b22_c174_4326_9688_fd2863e36f04.slice/crio-9119453baf57d8bc86fa424ab99555cf609edc7fe968aa80c327083cbfdfe413 WatchSource:0}: Error finding container 9119453baf57d8bc86fa424ab99555cf609edc7fe968aa80c327083cbfdfe413: Status 404 returned error can't find the container with id 9119453baf57d8bc86fa424ab99555cf609edc7fe968aa80c327083cbfdfe413
Sep 08 14:55:11.533404 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.533159    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:11.541492 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.539686    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g4pjk"
Sep 08 14:55:11.547092 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.546901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-hpggd"
Sep 08 14:55:11.548493 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:11.548314    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d5f41d_90c3_4008_8a33_838cd3330379.slice/crio-66d292bc3139162d97cc1e5436900431c4865eafbe31aad704ecc3e1196f0078 WatchSource:0}: Error finding container 66d292bc3139162d97cc1e5436900431c4865eafbe31aad704ecc3e1196f0078: Status 404 returned error can't find the container with id 66d292bc3139162d97cc1e5436900431c4865eafbe31aad704ecc3e1196f0078
Sep 08 14:55:11.551735 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.551713    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-m9ss5"
Sep 08 14:55:11.561291 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:11.561263    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2932f0_81e5_4cea_812f_122a0cea9375.slice/crio-9671bf7f62101032e44806fe4becd93473219c6cbd9ba447316fd4517d477d19 WatchSource:0}: Error finding container 9671bf7f62101032e44806fe4becd93473219c6cbd9ba447316fd4517d477d19: Status 404 returned error can't find the container with id 9671bf7f62101032e44806fe4becd93473219c6cbd9ba447316fd4517d477d19
Sep 08 14:55:11.817860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.817778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:11.817860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.817832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:11.818060 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.817955    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:11.818060 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.818025    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:55:12.818006416 +0000 UTC m=+3.965027329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:11.818060 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.817962    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:11.818217 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.818095    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:12.81807559 +0000 UTC m=+3.965096480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:11.918830 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:11.918774    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:11.918997 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.918971    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:11.919058 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.919000    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:11.919058 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.919015    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pb6lc for pod openshift-network-diagnostics/network-check-target-phsbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:11.919160 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:11.919082    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc podName:7a8f1386-02f6-4b25-94b2-b8ae737c32a7 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:12.919054958 +0000 UTC m=+4.066075843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pb6lc" (UniqueName: "kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc") pod "network-check-target-phsbw" (UID: "7a8f1386-02f6-4b25-94b2-b8ae737c32a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:12.239713 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.239665    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:50:11 +0000 UTC" deadline="2028-05-22 10:29:41.501131382 +0000 UTC"
Sep 08 14:55:12.239713 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.239712    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14923h34m29.261425886s"
Sep 08 14:55:12.381972 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.381943    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:12.382134 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.382071    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:12.388687 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.388663    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:55:12.394222 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.394191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hpggd" event={"ID":"1c2932f0-81e5-4cea-812f-122a0cea9375","Type":"ContainerStarted","Data":"9671bf7f62101032e44806fe4becd93473219c6cbd9ba447316fd4517d477d19"}
Sep 08 14:55:12.395649 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.395624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g4pjk" event={"ID":"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac","Type":"ContainerStarted","Data":"254ad13c556c0bbf86a0cf354d72c2916d9c67deb0e059eb498ae0a6a98b6322"}
Sep 08 14:55:12.400550 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.400413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"439b6a4c0a076d9d06d206898098fafb315f05e9e83aa1b23fed5410653a3be2"}
Sep 08 14:55:12.403413 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.403388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688" event={"ID":"73807993-fc1d-4a2d-8e47-dcbed1d89e19","Type":"ContainerStarted","Data":"40c3e7ff3de58b0cd45603300bc861eb462b15e4cca500f2c7b7a1a3e992ccfc"}
Sep 08 14:55:12.406116 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.406061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k7vrt" event={"ID":"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6","Type":"ContainerStarted","Data":"c0857950d1ce7f231a4affd04550c56e293dc2e0f1f24bf1c1349005adb4ab8e"}
Sep 08 14:55:12.408182 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.408152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9ss5" event={"ID":"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15","Type":"ContainerStarted","Data":"eaba91a726c5f0cd5ed86a4ca4fa578c62d5717f2edc894991d0d19f69ff31ed"}
Sep 08 14:55:12.411259 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.411234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qgt4k" event={"ID":"89d5f41d-90c3-4008-8a33-838cd3330379","Type":"ContainerStarted","Data":"66d292bc3139162d97cc1e5436900431c4865eafbe31aad704ecc3e1196f0078"}
Sep 08 14:55:12.416392 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.416368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbhnp" event={"ID":"bac42b22-c174-4326-9688-fd2863e36f04","Type":"ContainerStarted","Data":"9119453baf57d8bc86fa424ab99555cf609edc7fe968aa80c327083cbfdfe413"}
Sep 08 14:55:12.420661 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.420638    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerStarted","Data":"850ed6fb3070c05945fc7f0a1fd7f6b9567ad71984d23da857359fa31d4f2430"}
Sep 08 14:55:12.826033 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.825993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:12.826210 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.826054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:12.826274 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.826243    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:12.826321 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.826316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:14.826297426 +0000 UTC m=+5.973318328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:12.826835 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.826747    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:12.826835 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.826800    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:55:14.826783857 +0000 UTC m=+5.973804757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:12.927779 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:12.927139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:12.927779 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.927331    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:12.927779 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.927353    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:12.927779 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.927365    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pb6lc for pod openshift-network-diagnostics/network-check-target-phsbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:12.927779 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:12.927422    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc podName:7a8f1386-02f6-4b25-94b2-b8ae737c32a7 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:14.927404031 +0000 UTC m=+6.074424923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pb6lc" (UniqueName: "kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc") pod "network-check-target-phsbw" (UID: "7a8f1386-02f6-4b25-94b2-b8ae737c32a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:13.240428 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:13.240365    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:50:11 +0000 UTC" deadline="2028-06-01 08:29:24.581493764 +0000 UTC"
Sep 08 14:55:13.240428 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:13.240426    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15161h34m11.341071714s"
Sep 08 14:55:13.382495 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:13.382390    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:13.382495 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:13.382431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:13.382719 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:13.382524    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:13.382992 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:13.382893    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:14.381686 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.381662    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:14.382361 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.381778    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:14.428103 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.428069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" event={"ID":"0167a65271ebed0b746181fb3621931d","Type":"ContainerStarted","Data":"00b8e4c9e38c144019c18c821a16fee02e1fdacd3dcbeb7cc5f9b08d84cc29c6"}
Sep 08 14:55:14.431764 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.431722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"2693b87bf16c7efe119dacfb165b17ef","Type":"ContainerStarted","Data":"cec99a00ced6d5ad6a145bb515af4e32833ab654fd9e6f0103de5875a629e7d0"}
Sep 08 14:55:14.457083 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.457021    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" podStartSLOduration=4.4570037639999995 podStartE2EDuration="4.457003764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:14.442789653 +0000 UTC m=+5.589810562" watchObservedRunningTime="2026-09-08 14:55:14.457003764 +0000 UTC m=+5.604024672"
Sep 08 14:55:14.843038 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.843002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:14.843224 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.843055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:14.843224 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.843169    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:14.843224 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.843183    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:14.843379 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.843243    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:55:18.843223714 +0000 UTC m=+9.990244611 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:14.843379 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.843264    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:18.843253991 +0000 UTC m=+9.990274878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:14.943599 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:14.943566    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:14.943789 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.943738    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:14.943789 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.943768    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:14.943789 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.943781    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pb6lc for pod openshift-network-diagnostics/network-check-target-phsbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:14.943949 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:14.943834    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc podName:7a8f1386-02f6-4b25-94b2-b8ae737c32a7 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:18.943815904 +0000 UTC m=+10.090836796 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pb6lc" (UniqueName: "kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc") pod "network-check-target-phsbw" (UID: "7a8f1386-02f6-4b25-94b2-b8ae737c32a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:15.382170 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:15.382142    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:15.382609 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:15.382291    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:15.382609 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:15.382140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:15.382609 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:15.382574    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:16.382009 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:16.381975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:16.382175 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:16.382097    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:17.385815 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:17.385739    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:17.386244 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:17.385868    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:17.386244 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:17.386238    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:17.386408 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:17.386386    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:17.441848 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:17.441799    2579 generic.go:356] "Generic (PLEG): container finished" podID="2693b87bf16c7efe119dacfb165b17ef" containerID="cec99a00ced6d5ad6a145bb515af4e32833ab654fd9e6f0103de5875a629e7d0" exitCode=0
Sep 08 14:55:17.441990 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:17.441847    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"2693b87bf16c7efe119dacfb165b17ef","Type":"ContainerDied","Data":"cec99a00ced6d5ad6a145bb515af4e32833ab654fd9e6f0103de5875a629e7d0"}
Sep 08 14:55:18.381910 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:18.381666    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:18.381910 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.381795    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:18.878972 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:18.878261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:18.878972 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:18.878317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:18.878972 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.878465    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:18.878972 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.878524    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:26.878506677 +0000 UTC m=+18.025527579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:18.878972 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.878839    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:18.878972 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.878881    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:55:26.87886683 +0000 UTC m=+18.025887729 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:18.978917 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:18.978831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:18.979093 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.978982    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:18.979093 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.979001    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:18.979093 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.979011    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pb6lc for pod openshift-network-diagnostics/network-check-target-phsbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:18.979093 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:18.979059    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc podName:7a8f1386-02f6-4b25-94b2-b8ae737c32a7 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:26.979043776 +0000 UTC m=+18.126064665 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pb6lc" (UniqueName: "kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc") pod "network-check-target-phsbw" (UID: "7a8f1386-02f6-4b25-94b2-b8ae737c32a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:19.385716 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:19.385690    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:19.385881 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:19.385803    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:19.386128 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:19.386016    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:19.386231 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:19.386146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:20.381982 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:20.381947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:20.382469 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:20.382131    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:21.385864 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:21.385831    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:21.386279 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:21.385875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:21.386279 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:21.385964    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:21.386279 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:21.386091    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:22.381877 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:22.381848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:22.382039 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:22.381963    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:23.381740 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:23.381708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:23.382161 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:23.381815    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:23.382161 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:23.381903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:23.382161 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:23.382020    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:24.381658 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:24.381581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:24.381798 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:24.381685    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:25.381842 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:25.381807    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:25.382280 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:25.381947    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:25.382280 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:25.382005    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:25.382280 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:25.382171    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:26.381781 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:26.381741    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:26.381996 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:26.381883    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:26.933058 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:26.933021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:26.933235 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:26.933078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:26.933235 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:26.933153    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:26.933235 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:26.933217    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:55:42.933197866 +0000 UTC m=+34.080218752 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:26.933235 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:26.933227    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:26.933410 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:26.933286    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:55:42.933267919 +0000 UTC m=+34.080288821 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:27.034234 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:27.034196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:27.034388 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:27.034357    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:55:27.034388 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:27.034379    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:55:27.034524 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:27.034392    2579 projected.go:196] Error preparing data for projected volume kube-api-access-pb6lc for pod openshift-network-diagnostics/network-check-target-phsbw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:27.034524 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:27.034466    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc podName:7a8f1386-02f6-4b25-94b2-b8ae737c32a7 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:43.034432216 +0000 UTC m=+34.181453118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pb6lc" (UniqueName: "kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc") pod "network-check-target-phsbw" (UID: "7a8f1386-02f6-4b25-94b2-b8ae737c32a7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:55:27.382361 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:27.382280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:27.382798 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:27.382430    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:27.382798 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:27.382467    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:27.382798 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:27.382564    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:28.382222 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:28.382192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:28.382375 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:28.382285    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:29.382633 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:29.382608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:29.383015 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:29.382684    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:29.383015 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:29.382775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:29.383015 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:29.382859    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:30.381998 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.381796    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:30.382098 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:30.382039    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:30.466681 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.466649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"2693b87bf16c7efe119dacfb165b17ef","Type":"ContainerStarted","Data":"8168ef494a85dcb6dea3ca2c3c65f3e54a6f566a788d8ffad8fce111873006d3"}
Sep 08 14:55:30.468837 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.468809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-hpggd" event={"ID":"1c2932f0-81e5-4cea-812f-122a0cea9375","Type":"ContainerStarted","Data":"2fae3254e3dda30c7150a42ebf30c043548c211576c332ff81ae6ed9b11e153a"}
Sep 08 14:55:30.470575 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.470552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g4pjk" event={"ID":"4358d9ec-fe9c-4e92-9ec0-84c7bf057cac","Type":"ContainerStarted","Data":"e4d031c6a453784f2d73c34b6dd63e10829e223ea6bf218890c5b469d4dfaa92"}
Sep 08 14:55:30.473783 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.473760    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 14:55:30.474126 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474108    2579 generic.go:356] "Generic (PLEG): container finished" podID="7fb43d0e-8f1b-4d10-981c-122ed0eeaea2" containerID="067c235f686fdaadf7de78d0d00177f1d81fd7f9676df3e00b40e5eb3e31b50c" exitCode=1
Sep 08 14:55:30.474211 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474181    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"6e83c757b210741a736b583bb60f44afb7c0407fab82a89c58a49b4fbddfcdfe"}
Sep 08 14:55:30.474279 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474259    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"f9e4d90bb7c4469fb3cdf8dfc3f9603df936c7d93358b95c2fe771f181d767c2"}
Sep 08 14:55:30.474399 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"0e1150ed39b42e842a97a434661c628bb8ab78ed820de3311cae03d1a2c0453c"}
Sep 08 14:55:30.474399 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474370    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"520cb892df03f4d68c13d2011f9cc3e7115960ddf21b176b2a1546c460abc31d"}
Sep 08 14:55:30.474506 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474417    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerDied","Data":"067c235f686fdaadf7de78d0d00177f1d81fd7f9676df3e00b40e5eb3e31b50c"}
Sep 08 14:55:30.474506 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.474481    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"66261f5ee0ee31d3375171437d335691000684ba25657dbc4661f8b211668fd3"}
Sep 08 14:55:30.475832 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.475807    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688" event={"ID":"73807993-fc1d-4a2d-8e47-dcbed1d89e19","Type":"ContainerStarted","Data":"5f1ba194574d51a13c7d127ca24178df447ce09f99210df2cc63f885fa202552"}
Sep 08 14:55:30.477470 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.477434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-m9ss5" event={"ID":"2fefcbea-7d6b-4c4a-9dd3-4a9bcb32ad15","Type":"ContainerStarted","Data":"41b09bf3b74e2c0b199f60a490b484dc050bbf44c576affd454b251a80630f0a"}
Sep 08 14:55:30.479037 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.479014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qgt4k" event={"ID":"89d5f41d-90c3-4008-8a33-838cd3330379","Type":"ContainerStarted","Data":"711bfbbd1e0e195dfec29aacb9f2ac63a86bc63fbacd44122089d2ecbdd9b6d5"}
Sep 08 14:55:30.481728 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.481701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zbhnp" event={"ID":"bac42b22-c174-4326-9688-fd2863e36f04","Type":"ContainerStarted","Data":"21ef2a9d98fe3a57ec9690b29dad41d702d8ac2da7d310acc55b3dda98492aa9"}
Sep 08 14:55:30.483900 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.483874    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6af87d0-16d9-4d89-9706-f9ac2bad3561" containerID="d7c2d731a5ec00ed905ec9d8ae9df8d49f5e13783b463b93677e0f8225bbb23e" exitCode=0
Sep 08 14:55:30.483994 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.483903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerDied","Data":"d7c2d731a5ec00ed905ec9d8ae9df8d49f5e13783b463b93677e0f8225bbb23e"}
Sep 08 14:55:30.501423 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.501377    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zbhnp" podStartSLOduration=3.497641529 podStartE2EDuration="21.501364823s" totalImagesPullingTime="18.003723294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:30.500874331 +0000 UTC m=+21.647895240" watchObservedRunningTime="2026-09-08 14:55:30.501364823 +0000 UTC m=+21.648385742"
Sep 08 14:55:30.501563 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.501525    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" podStartSLOduration=20.501514902 podStartE2EDuration="20.501514902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:30.483666694 +0000 UTC m=+21.630687602" watchObservedRunningTime="2026-09-08 14:55:30.501514902 +0000 UTC m=+21.648536098"
Sep 08 14:55:30.514186 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.514144    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qgt4k" podStartSLOduration=3.525646341 podStartE2EDuration="21.514127696s" totalImagesPullingTime="17.988481355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:30.513630456 +0000 UTC m=+21.660651363" watchObservedRunningTime="2026-09-08 14:55:30.514127696 +0000 UTC m=+21.661148604"
Sep 08 14:55:30.529327 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.529274    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-hpggd" podStartSLOduration=3.812711062 podStartE2EDuration="21.529257042s" totalImagesPullingTime="17.71654598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:30.528722502 +0000 UTC m=+21.675743408" watchObservedRunningTime="2026-09-08 14:55:30.529257042 +0000 UTC m=+21.676277951"
Sep 08 14:55:30.552576 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.552536    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g4pjk" podStartSLOduration=3.662402116 podStartE2EDuration="21.552517443s" totalImagesPullingTime="17.890115327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:30.552503469 +0000 UTC m=+21.699524376" watchObservedRunningTime="2026-09-08 14:55:30.552517443 +0000 UTC m=+21.699538348"
Sep 08 14:55:30.570518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.570482    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-m9ss5" podStartSLOduration=3.422944726 podStartE2EDuration="21.570469934s" totalImagesPullingTime="18.147525208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:30.570339359 +0000 UTC m=+21.717360266" watchObservedRunningTime="2026-09-08 14:55:30.570469934 +0000 UTC m=+21.717490849"
Sep 08 14:55:30.827072 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.827049    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 14:55:30.999536 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:30.999480    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:31.000019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.000004    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:31.260587 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.260474    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T14:55:30.827066703Z","UUID":"a5d3bcee-5ffa-43b7-9bb2-d0aaba6a32c9","Handler":null,"Name":"","Endpoint":""}
Sep 08 14:55:31.261912 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.261892    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 14:55:31.262026 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.261925    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 14:55:31.381589 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.381564    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:31.381734 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:31.381682    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:31.381799 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.381744    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:31.381868 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:31.381844    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:31.488503 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.488476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688" event={"ID":"73807993-fc1d-4a2d-8e47-dcbed1d89e19","Type":"ContainerStarted","Data":"69f7aecd496962662d0ae4fcb43183ca03af7e9f2101fda0e67d0fff1c9620ef"}
Sep 08 14:55:31.490185 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.490119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k7vrt" event={"ID":"c0b6294c-5ea5-4d3e-97d5-1b34d130dad6","Type":"ContainerStarted","Data":"d861b0da162da1b2a288d931cba238d222a8c1d9a37e2e353af0ab1c466b62c1"}
Sep 08 14:55:31.490946 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.490748    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:31.491234 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.491211    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qgt4k"
Sep 08 14:55:31.512865 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:31.512787    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k7vrt" podStartSLOduration=5.615825079 podStartE2EDuration="22.512771548s" totalImagesPullingTime="16.896946469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:31.512388857 +0000 UTC m=+22.659409763" watchObservedRunningTime="2026-09-08 14:55:31.512771548 +0000 UTC m=+22.659792454"
Sep 08 14:55:32.382698 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:32.382516    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:32.382807 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:32.382729    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:32.494878 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:32.494855    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 14:55:32.495259 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:32.495238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"8f382742a78f04fd8f06a21e7c10d7504e5be38623e1361589b4cedaf66fa647"}
Sep 08 14:55:32.497161 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:32.497136    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688" event={"ID":"73807993-fc1d-4a2d-8e47-dcbed1d89e19","Type":"ContainerStarted","Data":"1a6a6cb690c1cf48d4075650625705b4c54ce79daab9fceee3d8f4a87c527363"}
Sep 08 14:55:32.513457 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:32.513418    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pf688" podStartSLOduration=3.654251904 podStartE2EDuration="23.513405502s" totalImagesPullingTime="19.859153598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:32.513398364 +0000 UTC m=+23.660419271" watchObservedRunningTime="2026-09-08 14:55:32.513405502 +0000 UTC m=+23.660426403"
Sep 08 14:55:33.382028 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:33.381992    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:33.382288 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:33.382003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:33.382288 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:33.382095    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:33.382288 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:33.382195    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:34.382097 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.382072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:34.382499 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:34.382203    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:34.505470 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.505379    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 14:55:34.505966 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.505921    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"28749ff21b54b1936ebcd1b98312c0eef29b72bfab9fa684ad86ed6ee539fd9b"}
Sep 08 14:55:34.506322 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.506296    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:34.506434 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.506402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:34.506516 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.506498    2579 scope.go:117] "RemoveContainer" containerID="067c235f686fdaadf7de78d0d00177f1d81fd7f9676df3e00b40e5eb3e31b50c"
Sep 08 14:55:34.524345 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:34.524148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:35.384994 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.384969    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:35.385333 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:35.385078    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:35.385333 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.385151    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:35.385333 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:35.385231    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:35.513120 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.513092    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 14:55:35.513502 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.513477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" event={"ID":"7fb43d0e-8f1b-4d10-981c-122ed0eeaea2","Type":"ContainerStarted","Data":"6d66f91cd8cc4d79d7c92fad8a50844f8aa23adbdd88764e4a6045e5ea87a024"}
Sep 08 14:55:35.513834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.513778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:35.541253 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.541220    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:55:35.546345 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:35.546296    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j" podStartSLOduration=8.549736558 podStartE2EDuration="26.54627675s" totalImagesPullingTime="17.996540192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:35.544688415 +0000 UTC m=+26.691709323" watchObservedRunningTime="2026-09-08 14:55:35.54627675 +0000 UTC m=+26.693297657"
Sep 08 14:55:36.161118 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:36.161087    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-phsbw"]
Sep 08 14:55:36.161358 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:36.161204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:36.161358 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:36.161307    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:36.164975 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:36.164951    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lfnx7"]
Sep 08 14:55:36.165107 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:36.165069    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:36.165217 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:36.165168    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:36.165595 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:36.165573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nv6hp"]
Sep 08 14:55:36.165697 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:36.165685    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:36.165824 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:36.165793    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:37.384896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:37.384869    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:37.384896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:37.384887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:37.385575 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:37.384983    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:37.385575 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:37.385111    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:38.382507 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:38.382484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:38.382607 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:38.382589    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:38.522877 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:38.522799    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6af87d0-16d9-4d89-9706-f9ac2bad3561" containerID="9bedfc7dcbd6251763a3a396e4d69bc88156b00616814ea21f299a29ec67264a" exitCode=0
Sep 08 14:55:38.522877 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:38.522849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerDied","Data":"9bedfc7dcbd6251763a3a396e4d69bc88156b00616814ea21f299a29ec67264a"}
Sep 08 14:55:39.382813 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:39.382668    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:39.382974 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:39.382862    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:39.382974 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:39.382738    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:39.383075 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:39.382988    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:40.382538 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:40.382507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:40.382979 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:40.382616    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-phsbw" podUID="7a8f1386-02f6-4b25-94b2-b8ae737c32a7"
Sep 08 14:55:41.382559 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:41.382526    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:41.382929 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:41.382535    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:41.382929 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:41.382640    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nv6hp" podUID="1fc94e5d-448a-4945-ae24-71f5170e623a"
Sep 08 14:55:41.382929 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:41.382765    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lfnx7" podUID="beed6b1a-f32d-44f6-83fc-bbd04306be8c"
Sep 08 14:55:42.148069 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.148043    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeReady"
Sep 08 14:55:42.148148 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.148137    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 14:55:42.181833 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.181809    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78cb84d85b-7hpxg"]
Sep 08 14:55:42.201467 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.201084    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-q5shh"]
Sep 08 14:55:42.201467 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.201234    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.203677 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.203660    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 14:55:42.204337 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.204173    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vqm8\""
Sep 08 14:55:42.204337 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.204214    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 14:55:42.204526 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.204508    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 14:55:42.211354 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.211332    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78cb84d85b-7hpxg"]
Sep 08 14:55:42.211483 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.211370    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xq9kj"]
Sep 08 14:55:42.211642 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.211627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.219759 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.219724    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hknbk\""
Sep 08 14:55:42.219885 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.219777    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 14:55:42.219885 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.219811    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 14:55:42.220216 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.220199    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 14:55:42.227289 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.227269    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xq9kj"]
Sep 08 14:55:42.227370 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.227298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5shh"]
Sep 08 14:55:42.227408 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.227384    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.230237 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.230220    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z5hlj\""
Sep 08 14:55:42.230339 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.230273    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 14:55:42.230339 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.230278    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 14:55:42.230539 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.230525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 14:55:42.341600 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.341565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:42.349456 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349421    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02abfb67-4e49-4073-80e2-faa480dfb423-tmp-dir\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.349527 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-installation-pull-secrets\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349527 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-trusted-ca\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349601 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349526    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-ca-trust-extracted\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349601 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-bound-sa-token\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349601 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349566    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rhrt\" (UniqueName: \"kubernetes.io/projected/02abfb67-4e49-4073-80e2-faa480dfb423-kube-api-access-2rhrt\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.349601 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349588    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91357713-dbb0-4d33-b2a0-059b45b22fd1-cert\") pod \"ingress-canary-xq9kj\" (UID: \"91357713-dbb0-4d33-b2a0-059b45b22fd1\") " pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.349715 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02abfb67-4e49-4073-80e2-faa480dfb423-config-volume\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.349715 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.349715 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349715 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngff7\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-kube-api-access-ngff7\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349715 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349697    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc24t\" (UniqueName: \"kubernetes.io/projected/91357713-dbb0-4d33-b2a0-059b45b22fd1-kube-api-access-sc24t\") pod \"ingress-canary-xq9kj\" (UID: \"91357713-dbb0-4d33-b2a0-059b45b22fd1\") " pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.349715 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-certificates\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.349882 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.349733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-image-registry-private-configuration\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.382194 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.382149    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:42.384310 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.384284    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:55:42.384587 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.384326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s4zv9\""
Sep 08 14:55:42.384587 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.384326    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:55:42.431112 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.431085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:42.450852 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450831    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rhrt\" (UniqueName: \"kubernetes.io/projected/02abfb67-4e49-4073-80e2-faa480dfb423-kube-api-access-2rhrt\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.450924 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91357713-dbb0-4d33-b2a0-059b45b22fd1-cert\") pod \"ingress-canary-xq9kj\" (UID: \"91357713-dbb0-4d33-b2a0-059b45b22fd1\") " pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.450924 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02abfb67-4e49-4073-80e2-faa480dfb423-config-volume\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.450924 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.450924 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngff7\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-kube-api-access-ngff7\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450964    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc24t\" (UniqueName: \"kubernetes.io/projected/91357713-dbb0-4d33-b2a0-059b45b22fd1-kube-api-access-sc24t\") pod \"ingress-canary-xq9kj\" (UID: \"91357713-dbb0-4d33-b2a0-059b45b22fd1\") " pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.450987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-certificates\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.450990    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.451012    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.451025    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cb84d85b-7hpxg: secret "image-registry-tls" not found
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.451047    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls podName:02abfb67-4e49-4073-80e2-faa480dfb423 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:42.951027729 +0000 UTC m=+34.098048629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls") pod "dns-default-q5shh" (UID: "02abfb67-4e49-4073-80e2-faa480dfb423") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.451079    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls podName:84eb2ac0-684f-4503-a3d8-175b2f93d3f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:42.951062877 +0000 UTC m=+34.098083778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls") pod "image-registry-78cb84d85b-7hpxg" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6") : secret "image-registry-tls" not found
Sep 08 14:55:42.451116 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-image-registry-private-configuration\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451522 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/02abfb67-4e49-4073-80e2-faa480dfb423-config-volume\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.451629 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-certificates\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451727 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451703    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02abfb67-4e49-4073-80e2-faa480dfb423-tmp-dir\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.451786 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-installation-pull-secrets\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451786 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-trusted-ca\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451868 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-ca-trust-extracted\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451868 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-bound-sa-token\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.451966 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.451946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02abfb67-4e49-4073-80e2-faa480dfb423-tmp-dir\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.452165 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.452141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-ca-trust-extracted\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.452649 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.452627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-trusted-ca\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.454944 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.454921    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-image-registry-private-configuration\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.455017 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.454954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/91357713-dbb0-4d33-b2a0-059b45b22fd1-cert\") pod \"ingress-canary-xq9kj\" (UID: \"91357713-dbb0-4d33-b2a0-059b45b22fd1\") " pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.455017 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.454985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-installation-pull-secrets\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.468153 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.468127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc24t\" (UniqueName: \"kubernetes.io/projected/91357713-dbb0-4d33-b2a0-059b45b22fd1-kube-api-access-sc24t\") pod \"ingress-canary-xq9kj\" (UID: \"91357713-dbb0-4d33-b2a0-059b45b22fd1\") " pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.468153 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.468136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rhrt\" (UniqueName: \"kubernetes.io/projected/02abfb67-4e49-4073-80e2-faa480dfb423-kube-api-access-2rhrt\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.472389 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.472370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngff7\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-kube-api-access-ngff7\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.481956 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.481932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-bound-sa-token\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.530169 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.530140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:42.532995 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.532971    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6af87d0-16d9-4d89-9706-f9ac2bad3561" containerID="a8b725665eb60ed3c29cc8e248b7fab115a744b0fd6faa32f0b659a060a54d76" exitCode=0
Sep 08 14:55:42.533078 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.533014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerDied","Data":"a8b725665eb60ed3c29cc8e248b7fab115a744b0fd6faa32f0b659a060a54d76"}
Sep 08 14:55:42.563726 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.563702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xq9kj"
Sep 08 14:55:42.600342 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.600319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:42.890476 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.890275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xq9kj"]
Sep 08 14:55:42.895522 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:42.895496    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91357713_dbb0_4d33_b2a0_059b45b22fd1.slice/crio-9b73dd8021540bba5ba2b49a5dced74f8c1c9e4218ac8d0f739b69802b0ba6f0 WatchSource:0}: Error finding container 9b73dd8021540bba5ba2b49a5dced74f8c1c9e4218ac8d0f739b69802b0ba6f0: Status 404 returned error can't find the container with id 9b73dd8021540bba5ba2b49a5dced74f8c1c9e4218ac8d0f739b69802b0ba6f0
Sep 08 14:55:42.956809 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.956744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:42.956809 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.956806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:42.956933 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.956859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:42.956933 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.956890    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:42.956933 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:42.956898    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.956946    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret podName:beed6b1a-f32d-44f6-83fc-bbd04306be8c nodeName:}" failed. No retries permitted until 2026-09-08 14:56:14.95692807 +0000 UTC m=+66.103948973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret") pod "global-pull-secret-syncer-lfnx7" (UID: "beed6b1a-f32d-44f6-83fc-bbd04306be8c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.956973    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.956983    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.957024    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls podName:02abfb67-4e49-4073-80e2-faa480dfb423 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:43.957011271 +0000 UTC m=+35.104032162 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls") pod "dns-default-q5shh" (UID: "02abfb67-4e49-4073-80e2-faa480dfb423") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.956977    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.957038    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:56:14.957031841 +0000 UTC m=+66.104052726 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.957040    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cb84d85b-7hpxg: secret "image-registry-tls" not found
Sep 08 14:55:42.957136 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:42.957071    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls podName:84eb2ac0-684f-4503-a3d8-175b2f93d3f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:43.957059923 +0000 UTC m=+35.104080823 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls") pod "image-registry-78cb84d85b-7hpxg" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6") : secret "image-registry-tls" not found
Sep 08 14:55:43.057679 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.057650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:43.060852 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.060823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb6lc\" (UniqueName: \"kubernetes.io/projected/7a8f1386-02f6-4b25-94b2-b8ae737c32a7-kube-api-access-pb6lc\") pod \"network-check-target-phsbw\" (UID: \"7a8f1386-02f6-4b25-94b2-b8ae737c32a7\") " pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:43.063160 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.063140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:43.165943 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.165908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:43.290178 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.290102    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:43.382133 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.382109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:55:43.382276 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.382114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:55:43.384385 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.384350    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:55:43.384939 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.384439    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:55:43.385144 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.385120    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wbt\""
Sep 08 14:55:43.468741 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.468711    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:43.530024 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.529979    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log" limit=1024
Sep 08 14:55:43.536987 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.536949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xq9kj" event={"ID":"91357713-dbb0-4d33-b2a0-059b45b22fd1","Type":"ContainerStarted","Data":"9b73dd8021540bba5ba2b49a5dced74f8c1c9e4218ac8d0f739b69802b0ba6f0"}
Sep 08 14:55:43.589416 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.589328    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-phsbw"]
Sep 08 14:55:43.761795 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:43.761765    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a8f1386_02f6_4b25_94b2_b8ae737c32a7.slice/crio-7372014b139ad7c2c770b128fdf61e62a6365ddc9984610690c957ca85c7cfa4 WatchSource:0}: Error finding container 7372014b139ad7c2c770b128fdf61e62a6365ddc9984610690c957ca85c7cfa4: Status 404 returned error can't find the container with id 7372014b139ad7c2c770b128fdf61e62a6365ddc9984610690c957ca85c7cfa4
Sep 08 14:55:43.964649 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.964616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:43.964649 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:43.964654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:43.964868 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:43.964771    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:43.964868 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:43.964771    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:43.964868 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:43.964841    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cb84d85b-7hpxg: secret "image-registry-tls" not found
Sep 08 14:55:43.964868 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:43.964845    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls podName:02abfb67-4e49-4073-80e2-faa480dfb423 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:45.96482579 +0000 UTC m=+37.111846677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls") pod "dns-default-q5shh" (UID: "02abfb67-4e49-4073-80e2-faa480dfb423") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:43.965032 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:43.964895    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls podName:84eb2ac0-684f-4503-a3d8-175b2f93d3f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:45.964880716 +0000 UTC m=+37.111901612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls") pod "image-registry-78cb84d85b-7hpxg" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6") : secret "image-registry-tls" not found
Sep 08 14:55:44.543676 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:44.543605    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6af87d0-16d9-4d89-9706-f9ac2bad3561" containerID="23eee14440897bfc78e9ba1d703aa8c25788a145df1687b8187c1ac03fdb03d6" exitCode=0
Sep 08 14:55:44.544285 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:44.543688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerDied","Data":"23eee14440897bfc78e9ba1d703aa8c25788a145df1687b8187c1ac03fdb03d6"}
Sep 08 14:55:44.545424 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:44.545400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-phsbw" event={"ID":"7a8f1386-02f6-4b25-94b2-b8ae737c32a7","Type":"ContainerStarted","Data":"7372014b139ad7c2c770b128fdf61e62a6365ddc9984610690c957ca85c7cfa4"}
Sep 08 14:55:45.984035 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:45.983803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:45.984035 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:45.983836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:45.984035 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:45.983955    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:45.984035 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:45.983969    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cb84d85b-7hpxg: secret "image-registry-tls" not found
Sep 08 14:55:45.984035 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:45.983984    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:45.984035 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:45.984026    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls podName:84eb2ac0-684f-4503-a3d8-175b2f93d3f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:49.984007509 +0000 UTC m=+41.131028394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls") pod "image-registry-78cb84d85b-7hpxg" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6") : secret "image-registry-tls" not found
Sep 08 14:55:45.984711 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:45.984050    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls podName:02abfb67-4e49-4073-80e2-faa480dfb423 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:49.984032564 +0000 UTC m=+41.131053453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls") pod "dns-default-q5shh" (UID: "02abfb67-4e49-4073-80e2-faa480dfb423") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:46.553830 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:46.553723    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xq9kj" event={"ID":"91357713-dbb0-4d33-b2a0-059b45b22fd1","Type":"ContainerStarted","Data":"bdf49e1a9bda468adac7a3b6b39155f3683b491c69361a5acea9f6416567dfe5"}
Sep 08 14:55:46.569833 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:46.569778    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xq9kj" podStartSLOduration=1.812205975 podStartE2EDuration="4.569759128s" totalImagesPullingTime="2.757553153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:46.569040245 +0000 UTC m=+37.716061162" watchObservedRunningTime="2026-09-08 14:55:46.569759128 +0000 UTC m=+37.716780037"
Sep 08 14:55:48.560311 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:48.560271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-phsbw" event={"ID":"7a8f1386-02f6-4b25-94b2-b8ae737c32a7","Type":"ContainerStarted","Data":"351e17d1431fcb6c1610b73ddeeef70e73c089ea998de53fa3d16476448a9a4b"}
Sep 08 14:55:48.560787 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:48.560353    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:55:48.576529 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:48.576481    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-phsbw" podStartSLOduration=35.732978553 podStartE2EDuration="39.576443097s" totalImagesPullingTime="3.843464544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:48.575834388 +0000 UTC m=+39.722855319" watchObservedRunningTime="2026-09-08 14:55:48.576443097 +0000 UTC m=+39.723463998"
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:50.017936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:50.017983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:50.018096    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:50.018154    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:50.018163    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls podName:02abfb67-4e49-4073-80e2-faa480dfb423 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:58.018143409 +0000 UTC m=+49.165164300 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls") pod "dns-default-q5shh" (UID: "02abfb67-4e49-4073-80e2-faa480dfb423") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:50.018169    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cb84d85b-7hpxg: secret "image-registry-tls" not found
Sep 08 14:55:50.018238 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:50.018214    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls podName:84eb2ac0-684f-4503-a3d8-175b2f93d3f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:55:58.018199341 +0000 UTC m=+49.165220249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls") pod "image-registry-78cb84d85b-7hpxg" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6") : secret "image-registry-tls" not found
Sep 08 14:55:50.567801 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:50.567772    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6af87d0-16d9-4d89-9706-f9ac2bad3561" containerID="2106843e67074a7d7a0565d9b6a0033aa168c0171a232ce1242722e52bc2456f" exitCode=0
Sep 08 14:55:50.567934 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:50.567809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerDied","Data":"2106843e67074a7d7a0565d9b6a0033aa168c0171a232ce1242722e52bc2456f"}
Sep 08 14:55:51.574787 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:51.574751    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6af87d0-16d9-4d89-9706-f9ac2bad3561" containerID="83393e89261c6bb4d8295777b25b520d5a1603c3618b3b54ee34111634b922a5" exitCode=0
Sep 08 14:55:51.575276 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:51.574795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerDied","Data":"83393e89261c6bb4d8295777b25b520d5a1603c3618b3b54ee34111634b922a5"}
Sep 08 14:55:52.580800 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:52.580763    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" event={"ID":"f6af87d0-16d9-4d89-9706-f9ac2bad3561","Type":"ContainerStarted","Data":"ac383a73f7aebabb03b53808584970bcb54389574b58a7068887e507fb9da2c4"}
Sep 08 14:55:52.613370 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:52.613322    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xgxjn" podStartSLOduration=7.32158539 podStartE2EDuration="43.613304668s" totalImagesPullingTime="36.291719278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:55:52.6124905 +0000 UTC m=+43.759511407" watchObservedRunningTime="2026-09-08 14:55:52.613304668 +0000 UTC m=+43.760325575"
Sep 08 14:55:55.997240 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:55.997198    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"]
Sep 08 14:55:56.027706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.027682    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-ngsg5"]
Sep 08 14:55:56.027831 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.027811    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.030371 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.030345    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qkblr\""
Sep 08 14:55:56.030371 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.030361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.030615 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.030481    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.030615 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.030481    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 14:55:56.030735 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.030678    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 14:55:56.050932 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.050908    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-ngsg5"]
Sep 08 14:55:56.051013 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.050939    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"]
Sep 08 14:55:56.051013 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.051008    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.053394 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.053377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-s9dnr\""
Sep 08 14:55:56.053394 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.053391    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 14:55:56.053559 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.053426    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.053559 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.053381    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 14:55:56.053559 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.053541    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.057728 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.057707    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 14:55:56.109958 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.109936    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-nz9gb"]
Sep 08 14:55:56.130908 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.130889    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"]
Sep 08 14:55:56.131054 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.131036    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.133424 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.133404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.133526 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.133471    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 08 14:55:56.134005 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.133854    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 08 14:55:56.134005 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.133862    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.134005 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.133908    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-c4qnd\""
Sep 08 14:55:56.138484 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.138467    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 08 14:55:56.155101 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.155085    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-nz9gb"]
Sep 08 14:55:56.155176 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.155110    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"]
Sep 08 14:55:56.155214 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.155192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"
Sep 08 14:55:56.158422 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.158408    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 14:55:56.158546 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.158530    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5c7l7\""
Sep 08 14:55:56.158803 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.158790    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:55:56.160548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-tmp\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.160646 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160604    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpbld\" (UniqueName: \"kubernetes.io/projected/732b7cf8-6646-4733-a491-e77fb719b00b-kube-api-access-xpbld\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.160806 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-snapshots\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.160806 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.160806 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvknv\" (UniqueName: \"kubernetes.io/projected/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-kube-api-access-vvknv\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.160806 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/732b7cf8-6646-4733-a491-e77fb719b00b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.160806 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.161016 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/732b7cf8-6646-4733-a491-e77fb719b00b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.161016 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.160868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-serving-cert\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.261736 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-tmp\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.261736 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6c8521a-181b-4aeb-a655-d0eecb5d7557-serving-cert\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.261846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261752    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpbld\" (UniqueName: \"kubernetes.io/projected/732b7cf8-6646-4733-a491-e77fb719b00b-kube-api-access-xpbld\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.261846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261783    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-snapshots\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.261917 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261837    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.261917 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvknv\" (UniqueName: \"kubernetes.io/projected/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-kube-api-access-vvknv\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.261987 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c8521a-181b-4aeb-a655-d0eecb5d7557-trusted-ca\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.261987 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.261947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/732b7cf8-6646-4733-a491-e77fb719b00b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.262070 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.262070 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262038    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/732b7cf8-6646-4733-a491-e77fb719b00b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.262175 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-serving-cert\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.262175 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6c8521a-181b-4aeb-a655-d0eecb5d7557-config\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.262175 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v56l\" (UniqueName: \"kubernetes.io/projected/d6c8521a-181b-4aeb-a655-d0eecb5d7557-kube-api-access-5v56l\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.262351 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzjf\" (UniqueName: \"kubernetes.io/projected/a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3-kube-api-access-8kzjf\") pod \"volume-data-source-validator-695c895bd6-kzdg4\" (UID: \"a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"
Sep 08 14:55:56.262623 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262595    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.262623 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262618    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/732b7cf8-6646-4733-a491-e77fb719b00b-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.263017 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-tmp\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.263263 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.262574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-snapshots\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.263770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.263736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.266359 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.266330    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/732b7cf8-6646-4733-a491-e77fb719b00b-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.266474 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.266336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-serving-cert\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.269972 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.269948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpbld\" (UniqueName: \"kubernetes.io/projected/732b7cf8-6646-4733-a491-e77fb719b00b-kube-api-access-xpbld\") pod \"kube-storage-version-migrator-operator-8d7dd4675-bkcvh\" (UID: \"732b7cf8-6646-4733-a491-e77fb719b00b\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.270051 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.269950    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvknv\" (UniqueName: \"kubernetes.io/projected/71db9847-e1f3-42dc-a9a6-1fb48e7e6624-kube-api-access-vvknv\") pod \"insights-operator-76bcd6ccf5-ngsg5\" (UID: \"71db9847-e1f3-42dc-a9a6-1fb48e7e6624\") " pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.336784 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.336763    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"
Sep 08 14:55:56.359080 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.359061    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5"
Sep 08 14:55:56.363297 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.363278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6c8521a-181b-4aeb-a655-d0eecb5d7557-config\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.363383 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.363309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v56l\" (UniqueName: \"kubernetes.io/projected/d6c8521a-181b-4aeb-a655-d0eecb5d7557-kube-api-access-5v56l\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.363383 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.363337    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzjf\" (UniqueName: \"kubernetes.io/projected/a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3-kube-api-access-8kzjf\") pod \"volume-data-source-validator-695c895bd6-kzdg4\" (UID: \"a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"
Sep 08 14:55:56.363523 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.363407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6c8521a-181b-4aeb-a655-d0eecb5d7557-serving-cert\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.363523 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.363472    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c8521a-181b-4aeb-a655-d0eecb5d7557-trusted-ca\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.363901 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.363878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6c8521a-181b-4aeb-a655-d0eecb5d7557-config\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.364179 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.364157    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d6c8521a-181b-4aeb-a655-d0eecb5d7557-trusted-ca\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.365315 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.365294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6c8521a-181b-4aeb-a655-d0eecb5d7557-serving-cert\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.370986 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.370958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v56l\" (UniqueName: \"kubernetes.io/projected/d6c8521a-181b-4aeb-a655-d0eecb5d7557-kube-api-access-5v56l\") pod \"console-operator-85b454874b-nz9gb\" (UID: \"d6c8521a-181b-4aeb-a655-d0eecb5d7557\") " pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.371192 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.371177    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzjf\" (UniqueName: \"kubernetes.io/projected/a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3-kube-api-access-8kzjf\") pod \"volume-data-source-validator-695c895bd6-kzdg4\" (UID: \"a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"
Sep 08 14:55:56.440802 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.440776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:55:56.463753 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.463726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"
Sep 08 14:55:56.631552 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.631526    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh"]
Sep 08 14:55:56.633910 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:56.633887    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732b7cf8_6646_4733_a491_e77fb719b00b.slice/crio-fa5af5f7033109b983dcc41b1094b0510d6470a1e8bd391a56f571a789dd7fc3 WatchSource:0}: Error finding container fa5af5f7033109b983dcc41b1094b0510d6470a1e8bd391a56f571a789dd7fc3: Status 404 returned error can't find the container with id fa5af5f7033109b983dcc41b1094b0510d6470a1e8bd391a56f571a789dd7fc3
Sep 08 14:55:56.664957 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.664936    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-ngsg5"]
Sep 08 14:55:56.667217 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:56.667199    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71db9847_e1f3_42dc_a9a6_1fb48e7e6624.slice/crio-ef8f152dc1287951f396cec115cefb5cf1029d80a27caabbda78d71e81604ba3 WatchSource:0}: Error finding container ef8f152dc1287951f396cec115cefb5cf1029d80a27caabbda78d71e81604ba3: Status 404 returned error can't find the container with id ef8f152dc1287951f396cec115cefb5cf1029d80a27caabbda78d71e81604ba3
Sep 08 14:55:56.733027 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.733000    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-nz9gb"]
Sep 08 14:55:56.735388 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:56.735367    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c8521a_181b_4aeb_a655_d0eecb5d7557.slice/crio-9670ebdc99cf9ad3338cf94448cddd91a5ef95c9ca9fcae265cf093fd23e3bb3 WatchSource:0}: Error finding container 9670ebdc99cf9ad3338cf94448cddd91a5ef95c9ca9fcae265cf093fd23e3bb3: Status 404 returned error can't find the container with id 9670ebdc99cf9ad3338cf94448cddd91a5ef95c9ca9fcae265cf093fd23e3bb3
Sep 08 14:55:56.770219 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:56.770168    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4"]
Sep 08 14:55:56.773155 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:55:56.773131    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda80d12c9_5c6d_4a0f_8168_d1d717e1e2e3.slice/crio-7ae56f5ea49473cbdb55859e2b8c46429d83c0dd18e825d022e6e6577fb2dda8 WatchSource:0}: Error finding container 7ae56f5ea49473cbdb55859e2b8c46429d83c0dd18e825d022e6e6577fb2dda8: Status 404 returned error can't find the container with id 7ae56f5ea49473cbdb55859e2b8c46429d83c0dd18e825d022e6e6577fb2dda8
Sep 08 14:55:57.598268 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:57.598231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" event={"ID":"d6c8521a-181b-4aeb-a655-d0eecb5d7557","Type":"ContainerStarted","Data":"9670ebdc99cf9ad3338cf94448cddd91a5ef95c9ca9fcae265cf093fd23e3bb3"}
Sep 08 14:55:57.600742 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:57.600668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh" event={"ID":"732b7cf8-6646-4733-a491-e77fb719b00b","Type":"ContainerStarted","Data":"fa5af5f7033109b983dcc41b1094b0510d6470a1e8bd391a56f571a789dd7fc3"}
Sep 08 14:55:57.603109 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:57.603047    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4" event={"ID":"a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3","Type":"ContainerStarted","Data":"7ae56f5ea49473cbdb55859e2b8c46429d83c0dd18e825d022e6e6577fb2dda8"}
Sep 08 14:55:57.605180 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:57.605110    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5" event={"ID":"71db9847-e1f3-42dc-a9a6-1fb48e7e6624","Type":"ContainerStarted","Data":"ef8f152dc1287951f396cec115cefb5cf1029d80a27caabbda78d71e81604ba3"}
Sep 08 14:55:58.073388 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:58.073350    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:55:58.073580 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:55:58.073396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:55:58.074179 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:58.073679    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:55:58.074179 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:58.073773    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls podName:02abfb67-4e49-4073-80e2-faa480dfb423 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:14.073750902 +0000 UTC m=+65.220771798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls") pod "dns-default-q5shh" (UID: "02abfb67-4e49-4073-80e2-faa480dfb423") : secret "dns-default-metrics-tls" not found
Sep 08 14:55:58.074371 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:58.074185    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 14:55:58.074371 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:58.074201    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cb84d85b-7hpxg: secret "image-registry-tls" not found
Sep 08 14:55:58.074371 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:55:58.074249    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls podName:84eb2ac0-684f-4503-a3d8-175b2f93d3f6 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:14.074234725 +0000 UTC m=+65.221255612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls") pod "image-registry-78cb84d85b-7hpxg" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6") : secret "image-registry-tls" not found
Sep 08 14:56:00.615278 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.615234    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5" event={"ID":"71db9847-e1f3-42dc-a9a6-1fb48e7e6624","Type":"ContainerStarted","Data":"f5eae8ec847ff0d4a41ecb281196ffad47b5b8bef6c8e8af6cf3892cd6ac54e5"}
Sep 08 14:56:00.616918 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.616898    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/0.log"
Sep 08 14:56:00.617010 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.616936    2579 generic.go:356] "Generic (PLEG): container finished" podID="d6c8521a-181b-4aeb-a655-d0eecb5d7557" containerID="dedff7cd9d68bb5a26c661f19cfd2d9190a49fa7a1314f3a2565a99abdc65bd9" exitCode=255
Sep 08 14:56:00.617010 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.616969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" event={"ID":"d6c8521a-181b-4aeb-a655-d0eecb5d7557","Type":"ContainerDied","Data":"dedff7cd9d68bb5a26c661f19cfd2d9190a49fa7a1314f3a2565a99abdc65bd9"}
Sep 08 14:56:00.617222 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.617198    2579 scope.go:117] "RemoveContainer" containerID="dedff7cd9d68bb5a26c661f19cfd2d9190a49fa7a1314f3a2565a99abdc65bd9"
Sep 08 14:56:00.619083 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.619061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh" event={"ID":"732b7cf8-6646-4733-a491-e77fb719b00b","Type":"ContainerStarted","Data":"7633c97cd5e4ab2a8849acd7715d13113fc307cf45a967e917352170cf5fc75f"}
Sep 08 14:56:00.620743 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.620722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4" event={"ID":"a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3","Type":"ContainerStarted","Data":"136c457ffb7bad38d19c1190c0c4cd02a8f50b0a126d89fba67dc5db159b7654"}
Sep 08 14:56:00.631761 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.631706    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5" podStartSLOduration=2.204386296 podStartE2EDuration="5.631691502s" totalImagesPullingTime="3.427305206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:00.630897826 +0000 UTC m=+51.777918734" watchObservedRunningTime="2026-09-08 14:56:00.631691502 +0000 UTC m=+51.778712410"
Sep 08 14:56:00.644224 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.644161    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh" podStartSLOduration=2.179414536 podStartE2EDuration="5.644143666s" totalImagesPullingTime="3.46472913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:00.6439766 +0000 UTC m=+51.790997508" watchObservedRunningTime="2026-09-08 14:56:00.644143666 +0000 UTC m=+51.791164570"
Sep 08 14:56:00.663224 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:00.663178    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-kzdg4" podStartSLOduration=1.348522586 podStartE2EDuration="4.663159474s" totalImagesPullingTime="3.314636888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:00.6620495 +0000 UTC m=+51.809070409" watchObservedRunningTime="2026-09-08 14:56:00.663159474 +0000 UTC m=+51.810180383"
Sep 08 14:56:01.589429 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.589387    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5nztf"]
Sep 08 14:56:01.591600 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.591579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.593856 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.593833    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 14:56:01.593997 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.593912    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xf5qg\""
Sep 08 14:56:01.593997 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.593933    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 14:56:01.603024 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.602999    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nztf"]
Sep 08 14:56:01.605111 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.605084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/254ae859-7b70-497f-bfe2-62fab5897af4-crio-socket\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.605229 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.605125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/254ae859-7b70-497f-bfe2-62fab5897af4-data-volume\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.605229 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.605165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.605229 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.605208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qn8r\" (UniqueName: \"kubernetes.io/projected/254ae859-7b70-497f-bfe2-62fab5897af4-kube-api-access-6qn8r\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.605392 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.605250    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.625564 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.625540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 14:56:01.625973 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.625958    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/0.log"
Sep 08 14:56:01.626015 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.625995    2579 generic.go:356] "Generic (PLEG): container finished" podID="d6c8521a-181b-4aeb-a655-d0eecb5d7557" containerID="76db4824d44f16da9c2ec143b0afbb09ea33201d0c52cb1a2dcc0fc802c87571" exitCode=255
Sep 08 14:56:01.626091 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.626065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" event={"ID":"d6c8521a-181b-4aeb-a655-d0eecb5d7557","Type":"ContainerDied","Data":"76db4824d44f16da9c2ec143b0afbb09ea33201d0c52cb1a2dcc0fc802c87571"}
Sep 08 14:56:01.626216 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.626124    2579 scope.go:117] "RemoveContainer" containerID="dedff7cd9d68bb5a26c661f19cfd2d9190a49fa7a1314f3a2565a99abdc65bd9"
Sep 08 14:56:01.626361 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.626340    2579 scope.go:117] "RemoveContainer" containerID="76db4824d44f16da9c2ec143b0afbb09ea33201d0c52cb1a2dcc0fc802c87571"
Sep 08 14:56:01.626614 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:01.626573    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-nz9gb_openshift-console-operator(d6c8521a-181b-4aeb-a655-d0eecb5d7557)\"" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" podUID="d6c8521a-181b-4aeb-a655-d0eecb5d7557"
Sep 08 14:56:01.705848 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.705793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/254ae859-7b70-497f-bfe2-62fab5897af4-crio-socket\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706049 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.705856    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/254ae859-7b70-497f-bfe2-62fab5897af4-data-volume\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706049 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.705887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/254ae859-7b70-497f-bfe2-62fab5897af4-crio-socket\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706049 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.705918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706243 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.706219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qn8r\" (UniqueName: \"kubernetes.io/projected/254ae859-7b70-497f-bfe2-62fab5897af4-kube-api-access-6qn8r\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706310 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:01.706009    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:01.706310 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.706262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/254ae859-7b70-497f-bfe2-62fab5897af4-data-volume\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706412 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:01.706319    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:02.206293541 +0000 UTC m=+53.353314441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:01.706412 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.706363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:01.706554 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:01.706502    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:01.706608 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:01.706584    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:02.206568113 +0000 UTC m=+53.353588998 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:01.717003 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:01.716978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qn8r\" (UniqueName: \"kubernetes.io/projected/254ae859-7b70-497f-bfe2-62fab5897af4-kube-api-access-6qn8r\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:02.211779 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:02.211740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:02.211980 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:02.211794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:02.211980 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:02.211865    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:02.211980 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:02.211914    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:02.211980 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:02.211921    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.211903651 +0000 UTC m=+54.358924539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:02.212141 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:02.212007    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:03.211991794 +0000 UTC m=+54.359012684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:02.631746 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:02.631669    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 14:56:02.632068 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:02.631975    2579 scope.go:117] "RemoveContainer" containerID="76db4824d44f16da9c2ec143b0afbb09ea33201d0c52cb1a2dcc0fc802c87571"
Sep 08 14:56:02.632149 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:02.632124    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-nz9gb_openshift-console-operator(d6c8521a-181b-4aeb-a655-d0eecb5d7557)\"" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" podUID="d6c8521a-181b-4aeb-a655-d0eecb5d7557"
Sep 08 14:56:03.219834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:03.219794    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:03.220000 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:03.219847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:03.220000 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:03.219901    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:03.220000 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:03.219938    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:03.220000 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:03.219957    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:05.219943133 +0000 UTC m=+56.366964018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:03.220000 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:03.219991    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:05.219977387 +0000 UTC m=+56.366998319 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:03.542619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:03.542540    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g4pjk_4358d9ec-fe9c-4e92-9ec0-84c7bf057cac/dns-node-resolver/0.log"
Sep 08 14:56:04.542142 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:04.542117    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hpggd_1c2932f0-81e5-4cea-812f-122a0cea9375/node-ca/0.log"
Sep 08 14:56:05.235876 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:05.235839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:05.236059 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:05.235900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:05.236059 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:05.235992    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:05.236059 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:05.236032    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:05.236059 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:05.236059    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:09.236042614 +0000 UTC m=+60.383063525 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:05.236221 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:05.236083    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:09.236070929 +0000 UTC m=+60.383091815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:05.542145 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:05.542050    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xq9kj_91357713-dbb0-4d33-b2a0-059b45b22fd1/serve-healthcheck-canary/0.log"
Sep 08 14:56:06.441664 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:06.441618    2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:56:06.441664 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:06.441685    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:56:06.442249 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:06.442117    2579 scope.go:117] "RemoveContainer" containerID="76db4824d44f16da9c2ec143b0afbb09ea33201d0c52cb1a2dcc0fc802c87571"
Sep 08 14:56:06.442355 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:06.442329    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-nz9gb_openshift-console-operator(d6c8521a-181b-4aeb-a655-d0eecb5d7557)\"" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" podUID="d6c8521a-181b-4aeb-a655-d0eecb5d7557"
Sep 08 14:56:07.529320 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:07.529294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phr6j"
Sep 08 14:56:09.263652 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:09.263625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:09.264001 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:09.263672    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:09.264001 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:09.263756    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:09.264001 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:09.263769    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:56:09.264001 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:09.263806    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:17.263792934 +0000 UTC m=+68.410813819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:09.264001 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:09.263819    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:17.26381342 +0000 UTC m=+68.410834305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : configmap "kube-rbac-proxy" not found
Sep 08 14:56:14.097725 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.097678    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:56:14.097725 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.097727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:56:14.100031 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.100010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/02abfb67-4e49-4073-80e2-faa480dfb423-metrics-tls\") pod \"dns-default-q5shh\" (UID: \"02abfb67-4e49-4073-80e2-faa480dfb423\") " pod="openshift-dns/dns-default-q5shh"
Sep 08 14:56:14.100130 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.100112    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"image-registry-78cb84d85b-7hpxg\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") " pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:56:14.315460 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.315428    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8vqm8\""
Sep 08 14:56:14.324109 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.324089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:56:14.349929 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.349854    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hknbk\""
Sep 08 14:56:14.357525 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.357503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-q5shh"
Sep 08 14:56:14.599347 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.599320    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78cb84d85b-7hpxg"]
Sep 08 14:56:14.602440 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:14.602418    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84eb2ac0_684f_4503_a3d8_175b2f93d3f6.slice/crio-e942c346ff75c23d64dd0fb44c4e7e0c7792994337e58560dca265bd51eeaa1b WatchSource:0}: Error finding container e942c346ff75c23d64dd0fb44c4e7e0c7792994337e58560dca265bd51eeaa1b: Status 404 returned error can't find the container with id e942c346ff75c23d64dd0fb44c4e7e0c7792994337e58560dca265bd51eeaa1b
Sep 08 14:56:14.632732 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.632705    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-q5shh"]
Sep 08 14:56:14.636518 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:14.636491    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02abfb67_4e49_4073_80e2_faa480dfb423.slice/crio-7095aa8fd7ab1950aa60f98a1851a4fb57257b1cca74723f481179e6af8297d4 WatchSource:0}: Error finding container 7095aa8fd7ab1950aa60f98a1851a4fb57257b1cca74723f481179e6af8297d4: Status 404 returned error can't find the container with id 7095aa8fd7ab1950aa60f98a1851a4fb57257b1cca74723f481179e6af8297d4
Sep 08 14:56:14.670424 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.670394    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5shh" event={"ID":"02abfb67-4e49-4073-80e2-faa480dfb423","Type":"ContainerStarted","Data":"7095aa8fd7ab1950aa60f98a1851a4fb57257b1cca74723f481179e6af8297d4"}
Sep 08 14:56:14.671953 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.671923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" event={"ID":"84eb2ac0-684f-4503-a3d8-175b2f93d3f6","Type":"ContainerStarted","Data":"3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045"}
Sep 08 14:56:14.672039 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.671958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" event={"ID":"84eb2ac0-684f-4503-a3d8-175b2f93d3f6","Type":"ContainerStarted","Data":"e942c346ff75c23d64dd0fb44c4e7e0c7792994337e58560dca265bd51eeaa1b"}
Sep 08 14:56:14.672079 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.672061    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:56:14.692427 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:14.692272    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" podStartSLOduration=65.692259398 podStartE2EDuration="1m5.692259398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:14.691855225 +0000 UTC m=+65.838876132" watchObservedRunningTime="2026-09-08 14:56:14.692259398 +0000 UTC m=+65.839280305"
Sep 08 14:56:15.006178 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.006140    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:56:15.006339 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.006283    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:56:15.008511 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.008490    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:56:15.008609 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.008519    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:56:15.017313 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:15.017295    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 14:56:15.017387 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:15.017380    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs podName:1fc94e5d-448a-4945-ae24-71f5170e623a nodeName:}" failed. No retries permitted until 2026-09-08 14:57:19.017363663 +0000 UTC m=+130.164384562 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs") pod "network-metrics-daemon-nv6hp" (UID: "1fc94e5d-448a-4945-ae24-71f5170e623a") : secret "metrics-daemon-secret" not found
Sep 08 14:56:15.019569 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.019546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/beed6b1a-f32d-44f6-83fc-bbd04306be8c-original-pull-secret\") pod \"global-pull-secret-syncer-lfnx7\" (UID: \"beed6b1a-f32d-44f6-83fc-bbd04306be8c\") " pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:56:15.199604 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.199577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lfnx7"
Sep 08 14:56:15.472478 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.472417    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lfnx7"]
Sep 08 14:56:15.476900 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:15.476871    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeed6b1a_f32d_44f6_83fc_bbd04306be8c.slice/crio-494177c7683bfadc2c8e292f4e81f7c40bdd873131a5943e3e09706466ec59a8 WatchSource:0}: Error finding container 494177c7683bfadc2c8e292f4e81f7c40bdd873131a5943e3e09706466ec59a8: Status 404 returned error can't find the container with id 494177c7683bfadc2c8e292f4e81f7c40bdd873131a5943e3e09706466ec59a8
Sep 08 14:56:15.676800 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:15.676767    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lfnx7" event={"ID":"beed6b1a-f32d-44f6-83fc-bbd04306be8c","Type":"ContainerStarted","Data":"494177c7683bfadc2c8e292f4e81f7c40bdd873131a5943e3e09706466ec59a8"}
Sep 08 14:56:17.325637 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.325562    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:17.325637 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.325620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:17.326012 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:17.325726    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:17.326012 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:17.325796    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls podName:254ae859-7b70-497f-bfe2-62fab5897af4 nodeName:}" failed. No retries permitted until 2026-09-08 14:56:33.325777423 +0000 UTC m=+84.472798324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5nztf" (UID: "254ae859-7b70-497f-bfe2-62fab5897af4") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:56:17.326245 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.326225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/254ae859-7b70-497f-bfe2-62fab5897af4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:17.686306 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.686270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5shh" event={"ID":"02abfb67-4e49-4073-80e2-faa480dfb423","Type":"ContainerStarted","Data":"fb120d85c198e7918996618c59262ef0caffc6fada9e5fcbbce6d0a982a2a473"}
Sep 08 14:56:17.686572 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.686329    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-q5shh" event={"ID":"02abfb67-4e49-4073-80e2-faa480dfb423","Type":"ContainerStarted","Data":"6b0080d09faa40060aa9b0b71f008aaca71d749bfc4536e4ab537340132fd20c"}
Sep 08 14:56:17.686572 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.686379    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-q5shh"
Sep 08 14:56:17.704803 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:17.704761    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-q5shh" podStartSLOduration=33.643946572 podStartE2EDuration="35.704745295s" totalImagesPullingTime="2.060798723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:17.703071123 +0000 UTC m=+68.850092033" watchObservedRunningTime="2026-09-08 14:56:17.704745295 +0000 UTC m=+68.851766202"
Sep 08 14:56:19.566089 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:19.566058    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-phsbw"
Sep 08 14:56:21.382839 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.382806    2579 scope.go:117] "RemoveContainer" containerID="76db4824d44f16da9c2ec143b0afbb09ea33201d0c52cb1a2dcc0fc802c87571"
Sep 08 14:56:21.702117 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.702092    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 14:56:21.702253 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.702209    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" event={"ID":"d6c8521a-181b-4aeb-a655-d0eecb5d7557","Type":"ContainerStarted","Data":"50d9ff076b24ea62215a4afcd87ccd74ede11c82d9b1674cd3d4c1f8feb05307"}
Sep 08 14:56:21.702583 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.702514    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:56:21.703982 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.703958    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lfnx7" event={"ID":"beed6b1a-f32d-44f6-83fc-bbd04306be8c","Type":"ContainerStarted","Data":"3e56061d9d35a8f4b5f16ad456dc5068148b3a349a4dcb9cfd9cd249d505f6bd"}
Sep 08 14:56:21.717512 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.717469    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-nz9gb" podStartSLOduration=22.361973237 podStartE2EDuration="25.717436605s" totalImagesPullingTime="3.355463368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:21.716517969 +0000 UTC m=+72.863538876" watchObservedRunningTime="2026-09-08 14:56:21.717436605 +0000 UTC m=+72.864457514"
Sep 08 14:56:21.729157 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:21.729117    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lfnx7" podStartSLOduration=67.617930916 podStartE2EDuration="1m12.729106538s" totalImagesPullingTime="5.111175622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:21.728498054 +0000 UTC m=+72.875518962" watchObservedRunningTime="2026-09-08 14:56:21.729106538 +0000 UTC m=+72.876127446"
Sep 08 14:56:22.112542 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:22.112474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-nz9gb"
Sep 08 14:56:27.145834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.145799    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"]
Sep 08 14:56:27.148242 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.148226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.150345 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.150326    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:56:27.151051 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.151032    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 14:56:27.151161 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.151130    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:56:27.152121 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.152105    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:56:27.164634 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.164615    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"]
Sep 08 14:56:27.194837 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.194816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bftrg\" (UniqueName: \"kubernetes.io/projected/d2944bfd-50aa-43f0-88df-b4fce2644743-kube-api-access-bftrg\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.194935 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.194859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2944bfd-50aa-43f0-88df-b4fce2644743-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.194935 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.194888    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2944bfd-50aa-43f0-88df-b4fce2644743-tmp\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.261379 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.261360    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-92sfl"]
Sep 08 14:56:27.263219 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.263205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.265469 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.265418    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 08 14:56:27.265566 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.265477    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 08 14:56:27.265749 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.265733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-njq75\""
Sep 08 14:56:27.278969 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.278949    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-92sfl"]
Sep 08 14:56:27.295457 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.295428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bftrg\" (UniqueName: \"kubernetes.io/projected/d2944bfd-50aa-43f0-88df-b4fce2644743-kube-api-access-bftrg\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.295537 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.295493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2944bfd-50aa-43f0-88df-b4fce2644743-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.295537 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.295523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2944bfd-50aa-43f0-88df-b4fce2644743-tmp\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.295903 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.295887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2944bfd-50aa-43f0-88df-b4fce2644743-tmp\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.297983 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.297919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/d2944bfd-50aa-43f0-88df-b4fce2644743-klusterlet-config\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.306458 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.306426    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bftrg\" (UniqueName: \"kubernetes.io/projected/d2944bfd-50aa-43f0-88df-b4fce2644743-kube-api-access-bftrg\") pod \"klusterlet-addon-workmgr-7d85cddb59-9wlwb\" (UID: \"d2944bfd-50aa-43f0-88df-b4fce2644743\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.395817 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.395794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6290b9f9-de04-4765-89a8-dff0d597ee3f-nginx-conf\") pod \"networking-console-plugin-79977f9844-92sfl\" (UID: \"6290b9f9-de04-4765-89a8-dff0d597ee3f\") " pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.395919 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.395855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6290b9f9-de04-4765-89a8-dff0d597ee3f-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-92sfl\" (UID: \"6290b9f9-de04-4765-89a8-dff0d597ee3f\") " pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.457393 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.457370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:27.496525 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.496495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6290b9f9-de04-4765-89a8-dff0d597ee3f-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-92sfl\" (UID: \"6290b9f9-de04-4765-89a8-dff0d597ee3f\") " pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.496642 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.496542    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6290b9f9-de04-4765-89a8-dff0d597ee3f-nginx-conf\") pod \"networking-console-plugin-79977f9844-92sfl\" (UID: \"6290b9f9-de04-4765-89a8-dff0d597ee3f\") " pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.497089 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.497069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6290b9f9-de04-4765-89a8-dff0d597ee3f-nginx-conf\") pod \"networking-console-plugin-79977f9844-92sfl\" (UID: \"6290b9f9-de04-4765-89a8-dff0d597ee3f\") " pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.498736 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.498713    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6290b9f9-de04-4765-89a8-dff0d597ee3f-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-92sfl\" (UID: \"6290b9f9-de04-4765-89a8-dff0d597ee3f\") " pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.571081 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.571053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl"
Sep 08 14:56:27.692645 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.692592    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-q5shh"
Sep 08 14:56:27.727363 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.727341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"]
Sep 08 14:56:27.730372 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:27.730347    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2944bfd_50aa_43f0_88df_b4fce2644743.slice/crio-53e6f77ed4a935d92a4ae6865b7e34a6208d1ba6b1ef655be804ee14d7badca9 WatchSource:0}: Error finding container 53e6f77ed4a935d92a4ae6865b7e34a6208d1ba6b1ef655be804ee14d7badca9: Status 404 returned error can't find the container with id 53e6f77ed4a935d92a4ae6865b7e34a6208d1ba6b1ef655be804ee14d7badca9
Sep 08 14:56:27.834520 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:27.834497    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-92sfl"]
Sep 08 14:56:27.837521 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:27.837499    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6290b9f9_de04_4765_89a8_dff0d597ee3f.slice/crio-aa798e8d0f4b057663abe84c04f5fdbe91b96a7eb053e27651b93c3f12d4c04f WatchSource:0}: Error finding container aa798e8d0f4b057663abe84c04f5fdbe91b96a7eb053e27651b93c3f12d4c04f: Status 404 returned error can't find the container with id aa798e8d0f4b057663abe84c04f5fdbe91b96a7eb053e27651b93c3f12d4c04f
Sep 08 14:56:28.732416 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:28.732347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl" event={"ID":"6290b9f9-de04-4765-89a8-dff0d597ee3f","Type":"ContainerStarted","Data":"aa798e8d0f4b057663abe84c04f5fdbe91b96a7eb053e27651b93c3f12d4c04f"}
Sep 08 14:56:28.733906 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:28.733874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb" event={"ID":"d2944bfd-50aa-43f0-88df-b4fce2644743","Type":"ContainerStarted","Data":"53e6f77ed4a935d92a4ae6865b7e34a6208d1ba6b1ef655be804ee14d7badca9"}
Sep 08 14:56:32.749880 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:32.749840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl" event={"ID":"6290b9f9-de04-4765-89a8-dff0d597ee3f","Type":"ContainerStarted","Data":"25caab6b78d7f9700a33455be5c4345a68141155b13f18d412bc907aff593160"}
Sep 08 14:56:32.751318 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:32.751295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb" event={"ID":"d2944bfd-50aa-43f0-88df-b4fce2644743","Type":"ContainerStarted","Data":"26446f224aaf534d9e6846ec754d9f0975785cebfe8dc409abaf90f4a6fd2a52"}
Sep 08 14:56:32.751503 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:32.751482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:32.752992 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:32.752970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb"
Sep 08 14:56:32.763776 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:32.763724    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-92sfl" podStartSLOduration=1.8073752 podStartE2EDuration="5.763706592s" totalImagesPullingTime="3.956331392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:32.763294691 +0000 UTC m=+83.910315598" watchObservedRunningTime="2026-09-08 14:56:32.763706592 +0000 UTC m=+83.910727500"
Sep 08 14:56:32.778542 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:32.778497    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7d85cddb59-9wlwb" podStartSLOduration=1.703003434 podStartE2EDuration="5.778480883s" totalImagesPullingTime="4.075477449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:32.778114538 +0000 UTC m=+83.925135446" watchObservedRunningTime="2026-09-08 14:56:32.778480883 +0000 UTC m=+83.925501815"
Sep 08 14:56:33.172134 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.172105    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7769c7444d-l92dg"]
Sep 08 14:56:33.192717 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.192695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7769c7444d-l92dg"]
Sep 08 14:56:33.192837 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.192778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.195220 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.195198    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 14:56:33.195356 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.195308    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 14:56:33.195425 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.195355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 14:56:33.195504 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.195425    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:56:33.196045 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.196018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 14:56:33.196191 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.196169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6xplc\""
Sep 08 14:56:33.196257 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.196231    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 14:56:33.196307 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.196258    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:56:33.343860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.343834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-oauth-serving-cert\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.343999 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.343881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-serving-cert\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.343999 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.343925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-oauth-config\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.343999 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.343949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-service-ca\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.343999 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.343972    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmj5l\" (UniqueName: \"kubernetes.io/projected/12bc6255-f9e7-4a66-acc3-abd83d390993-kube-api-access-pmj5l\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.344155 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.344052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-console-config\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.344155 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.344083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:33.346375 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.346350    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/254ae859-7b70-497f-bfe2-62fab5897af4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5nztf\" (UID: \"254ae859-7b70-497f-bfe2-62fab5897af4\") " pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:33.403032 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.403010    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xf5qg\""
Sep 08 14:56:33.411666 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.411649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5nztf"
Sep 08 14:56:33.444929 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.444900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-console-config\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445020 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.444982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-oauth-serving-cert\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445066 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-serving-cert\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445102 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-oauth-config\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445102 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-service-ca\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445193 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmj5l\" (UniqueName: \"kubernetes.io/projected/12bc6255-f9e7-4a66-acc3-abd83d390993-kube-api-access-pmj5l\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445652 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-console-config\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445738 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445682    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-oauth-serving-cert\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.445867 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.445846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-service-ca\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.447589 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.447567    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-serving-cert\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.448019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.448001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-oauth-config\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.453259 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.453241    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmj5l\" (UniqueName: \"kubernetes.io/projected/12bc6255-f9e7-4a66-acc3-abd83d390993-kube-api-access-pmj5l\") pod \"console-7769c7444d-l92dg\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") " pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.502040 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.502011    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:33.688089 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.688022    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5nztf"]
Sep 08 14:56:33.690776 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:33.690748    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254ae859_7b70_497f_bfe2_62fab5897af4.slice/crio-7c7f563e0a1fd56582e229813c313d714c5bfcecd1f7d714126049b379294eb0 WatchSource:0}: Error finding container 7c7f563e0a1fd56582e229813c313d714c5bfcecd1f7d714126049b379294eb0: Status 404 returned error can't find the container with id 7c7f563e0a1fd56582e229813c313d714c5bfcecd1f7d714126049b379294eb0
Sep 08 14:56:33.755312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.755278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nztf" event={"ID":"254ae859-7b70-497f-bfe2-62fab5897af4","Type":"ContainerStarted","Data":"7c7f563e0a1fd56582e229813c313d714c5bfcecd1f7d714126049b379294eb0"}
Sep 08 14:56:33.791104 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:33.791082    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7769c7444d-l92dg"]
Sep 08 14:56:33.794232 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:33.794208    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bc6255_f9e7_4a66_acc3_abd83d390993.slice/crio-eb9eb7068d9684334f517d0c65a162e513f54da34c318d6c9fa84f8cde8943d2 WatchSource:0}: Error finding container eb9eb7068d9684334f517d0c65a162e513f54da34c318d6c9fa84f8cde8943d2: Status 404 returned error can't find the container with id eb9eb7068d9684334f517d0c65a162e513f54da34c318d6c9fa84f8cde8943d2
Sep 08 14:56:34.328215 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:34.328184    2579 patch_prober.go:28] interesting pod/image-registry-78cb84d85b-7hpxg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 14:56:34.328469 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:34.328240    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" podUID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:56:34.760216 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:34.760180    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nztf" event={"ID":"254ae859-7b70-497f-bfe2-62fab5897af4","Type":"ContainerStarted","Data":"a0b78ba4243c95576314e9c23519b8414ca36c1f61ccd6d31fbf0537de295bc2"}
Sep 08 14:56:34.760587 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:34.760238    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nztf" event={"ID":"254ae859-7b70-497f-bfe2-62fab5897af4","Type":"ContainerStarted","Data":"ce24f65e2f4d8d67d97641d10d30d526e21e8d145c5689443871db134a8632e5"}
Sep 08 14:56:34.761414 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:34.761390    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7769c7444d-l92dg" event={"ID":"12bc6255-f9e7-4a66-acc3-abd83d390993","Type":"ContainerStarted","Data":"eb9eb7068d9684334f517d0c65a162e513f54da34c318d6c9fa84f8cde8943d2"}
Sep 08 14:56:35.278525 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.278494    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"]
Sep 08 14:56:35.280655 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.280631    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:35.282942 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.282918    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-79bc6\""
Sep 08 14:56:35.283068 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.283012    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 14:56:35.290107 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.290085    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"]
Sep 08 14:56:35.363220 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.363183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nvtjv\" (UID: \"797c1a06-8cfd-419b-958b-6f0c9d4593dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:35.464116 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.464072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nvtjv\" (UID: \"797c1a06-8cfd-419b-958b-6f0c9d4593dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:35.464287 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:35.464242    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 14:56:35.464347 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:35.464316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates podName:797c1a06-8cfd-419b-958b-6f0c9d4593dc nodeName:}" failed. No retries permitted until 2026-09-08 14:56:35.964298981 +0000 UTC m=+87.111319890 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-nvtjv" (UID: "797c1a06-8cfd-419b-958b-6f0c9d4593dc") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 14:56:35.683153 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.683057    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:56:35.967885 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:35.967799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nvtjv\" (UID: \"797c1a06-8cfd-419b-958b-6f0c9d4593dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:35.968241 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:35.967950    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 14:56:35.968241 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:35.968012    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates podName:797c1a06-8cfd-419b-958b-6f0c9d4593dc nodeName:}" failed. No retries permitted until 2026-09-08 14:56:36.967997263 +0000 UTC m=+88.115018151 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-nvtjv" (UID: "797c1a06-8cfd-419b-958b-6f0c9d4593dc") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 14:56:36.976346 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:36.976310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nvtjv\" (UID: \"797c1a06-8cfd-419b-958b-6f0c9d4593dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:36.978796 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:36.978769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/797c1a06-8cfd-419b-958b-6f0c9d4593dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-nvtjv\" (UID: \"797c1a06-8cfd-419b-958b-6f0c9d4593dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:37.092851 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.092815    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:37.510911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.510885    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"]
Sep 08 14:56:37.513206 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:37.513181    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797c1a06_8cfd_419b_958b_6f0c9d4593dc.slice/crio-5a912d065e2679a044fd6e448ab80298311390870d1771e2afc12bc5b87cd669 WatchSource:0}: Error finding container 5a912d065e2679a044fd6e448ab80298311390870d1771e2afc12bc5b87cd669: Status 404 returned error can't find the container with id 5a912d065e2679a044fd6e448ab80298311390870d1771e2afc12bc5b87cd669
Sep 08 14:56:37.774506 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.774416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7769c7444d-l92dg" event={"ID":"12bc6255-f9e7-4a66-acc3-abd83d390993","Type":"ContainerStarted","Data":"1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3"}
Sep 08 14:56:37.775651 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.775622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv" event={"ID":"797c1a06-8cfd-419b-958b-6f0c9d4593dc","Type":"ContainerStarted","Data":"5a912d065e2679a044fd6e448ab80298311390870d1771e2afc12bc5b87cd669"}
Sep 08 14:56:37.777655 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.777631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5nztf" event={"ID":"254ae859-7b70-497f-bfe2-62fab5897af4","Type":"ContainerStarted","Data":"8edb18d216c56b5c549ef4f94a50bcc1468cd17b864c88568d20170fed4ce14a"}
Sep 08 14:56:37.795297 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.795250    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7769c7444d-l92dg" podStartSLOduration=1.33842426 podStartE2EDuration="4.795235911s" totalImagesPullingTime="3.456811651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:37.793804919 +0000 UTC m=+88.940825825" watchObservedRunningTime="2026-09-08 14:56:37.795235911 +0000 UTC m=+88.942256809"
Sep 08 14:56:37.809287 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:37.809249    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5nztf" podStartSLOduration=33.398349996 podStartE2EDuration="36.809236538s" totalImagesPullingTime="3.410886542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:56:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:37.808621764 +0000 UTC m=+88.955642671" watchObservedRunningTime="2026-09-08 14:56:37.809236538 +0000 UTC m=+88.956257445"
Sep 08 14:56:40.788771 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:40.788736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv" event={"ID":"797c1a06-8cfd-419b-958b-6f0c9d4593dc","Type":"ContainerStarted","Data":"0294d979bff239c0dc4909f4f17ed023f077db0ca0b2fca29cc0986da2635977"}
Sep 08 14:56:40.789117 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:40.788956    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:40.793650 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:40.793628    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv"
Sep 08 14:56:40.804425 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:40.804383    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-nvtjv" podStartSLOduration=3.455930884 podStartE2EDuration="5.804370903s" totalImagesPullingTime="2.348440019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:40.804075205 +0000 UTC m=+91.951096114" watchObservedRunningTime="2026-09-08 14:56:40.804370903 +0000 UTC m=+91.951391806"
Sep 08 14:56:43.502939 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:43.502894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:43.503334 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:43.502961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:43.507614 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:43.507587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:43.803618 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:43.803540    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:56:49.595176 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:49.595142    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78cb84d85b-7hpxg"]
Sep 08 14:56:52.664400 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.664366    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"]
Sep 08 14:56:52.667219 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.667201    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.670386 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.670361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 14:56:52.670386 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.670374    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:56:52.670583 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.670373    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2nlkr\""
Sep 08 14:56:52.670583 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.670420    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 14:56:52.670583 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.670465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 14:56:52.670583 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.670516    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 14:56:52.678413 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.678391    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"]
Sep 08 14:56:52.726572 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.726546    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lmzmb"]
Sep 08 14:56:52.728629 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.728615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.731524 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.731495    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6k5q8\""
Sep 08 14:56:52.731524 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.731517    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:56:52.731656 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.731609    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:56:52.731656 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.731624    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:56:52.791091 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.791071    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.791183 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.791114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.791219 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.791195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.791255 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.791226    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-799x5\" (UniqueName: \"kubernetes.io/projected/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-kube-api-access-799x5\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.891500 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-tls\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891591 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb09e40-7af6-426c-b29c-e26400b4fe39-metrics-client-ca\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891591 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dml5g\" (UniqueName: \"kubernetes.io/projected/6cb09e40-7af6-426c-b29c-e26400b4fe39-kube-api-access-dml5g\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891591 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-textfile\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891711 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891607    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.891711 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-sys\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891711 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891711 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-root\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891711 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-wtmp\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891898 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.891898 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-799x5\" (UniqueName: \"kubernetes.io/projected/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-kube-api-access-799x5\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.891969 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.891969 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.891951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.892089 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:52.892071    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 08 14:56:52.892153 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:56:52.892142    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-tls podName:9a0c5c2a-2f29-469a-a3fe-9497e284a04c nodeName:}" failed. No retries permitted until 2026-09-08 14:56:53.392123202 +0000 UTC m=+104.539144089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-zbgf6" (UID: "9a0c5c2a-2f29-469a-a3fe-9497e284a04c") : secret "openshift-state-metrics-tls" not found
Sep 08 14:56:52.892435 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.892416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.894282 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.894253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.901278 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.901248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-799x5\" (UniqueName: \"kubernetes.io/projected/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-kube-api-access-799x5\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:52.992643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992583    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-sys\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992784 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992665    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-sys\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992784 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992701    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-root\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992784 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-wtmp\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992784 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992985 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-tls\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992985 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-root\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992985 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb09e40-7af6-426c-b29c-e26400b4fe39-metrics-client-ca\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992985 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992870    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dml5g\" (UniqueName: \"kubernetes.io/projected/6cb09e40-7af6-426c-b29c-e26400b4fe39-kube-api-access-dml5g\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992985 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992890    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-wtmp\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.992985 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.992902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-textfile\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.993336 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.993316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-textfile\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.993508 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.993489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-accelerators-collector-config\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.993577 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.993550    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cb09e40-7af6-426c-b29c-e26400b4fe39-metrics-client-ca\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.994827 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.994805    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.995089 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.995069    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cb09e40-7af6-426c-b29c-e26400b4fe39-node-exporter-tls\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:52.999867 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:52.999843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dml5g\" (UniqueName: \"kubernetes.io/projected/6cb09e40-7af6-426c-b29c-e26400b4fe39-kube-api-access-dml5g\") pod \"node-exporter-lmzmb\" (UID: \"6cb09e40-7af6-426c-b29c-e26400b4fe39\") " pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:53.036844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.036813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lmzmb"
Sep 08 14:56:53.046075 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:53.046052    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cb09e40_7af6_426c_b29c_e26400b4fe39.slice/crio-b658596c9a6309e37ef72873f91ce6a12f53e4028caf36182c2628bf073eb978 WatchSource:0}: Error finding container b658596c9a6309e37ef72873f91ce6a12f53e4028caf36182c2628bf073eb978: Status 404 returned error can't find the container with id b658596c9a6309e37ef72873f91ce6a12f53e4028caf36182c2628bf073eb978
Sep 08 14:56:53.396585 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.396564    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:53.398827 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.398806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9a0c5c2a-2f29-469a-a3fe-9497e284a04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-zbgf6\" (UID: \"9a0c5c2a-2f29-469a-a3fe-9497e284a04c\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:53.576728 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.576700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"
Sep 08 14:56:53.763681 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.763603    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:56:53.766382 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.766360    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.768753 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.768728    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 14:56:53.768828 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.768775    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 14:56:53.768828 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.768742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 14:56:53.769049 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769024    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 14:56:53.769191 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769072    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 14:56:53.769191 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769082    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 14:56:53.769191 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 14:56:53.769368 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769234    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 14:56:53.769368 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769346    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 14:56:53.769466 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.769404    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rrj6m\""
Sep 08 14:56:53.786112 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.786088    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:56:53.836795 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.836763    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmzmb" event={"ID":"6cb09e40-7af6-426c-b29c-e26400b4fe39","Type":"ContainerStarted","Data":"b658596c9a6309e37ef72873f91ce6a12f53e4028caf36182c2628bf073eb978"}
Sep 08 14:56:53.851375 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.851351    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6"]
Sep 08 14:56:53.853963 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:53.853940    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a0c5c2a_2f29_469a_a3fe_9497e284a04c.slice/crio-31a444b434559196ae806b418cbeb15dc17bcde87d0532c9c0642c3abd00c0e2 WatchSource:0}: Error finding container 31a444b434559196ae806b418cbeb15dc17bcde87d0532c9c0642c3abd00c0e2: Status 404 returned error can't find the container with id 31a444b434559196ae806b418cbeb15dc17bcde87d0532c9c0642c3abd00c0e2
Sep 08 14:56:53.900789 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-web-config\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.900881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.900881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900837    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c0713a2-f2d6-47e3-a640-499918b46949-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.900881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.900881 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900878    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901074 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlgbm\" (UniqueName: \"kubernetes.io/projected/1c0713a2-f2d6-47e3-a640-499918b46949-kube-api-access-rlgbm\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901074 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900963    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901074 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.900993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0713a2-f2d6-47e3-a640-499918b46949-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901074 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.901059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901269 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.901104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c0713a2-f2d6-47e3-a640-499918b46949-config-out\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901269 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.901125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c0713a2-f2d6-47e3-a640-499918b46949-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901269 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.901154    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:53.901269 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:53.901214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c0713a2-f2d6-47e3-a640-499918b46949-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002466 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlgbm\" (UniqueName: \"kubernetes.io/projected/1c0713a2-f2d6-47e3-a640-499918b46949-kube-api-access-rlgbm\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0713a2-f2d6-47e3-a640-499918b46949-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002643 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002665    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c0713a2-f2d6-47e3-a640-499918b46949-config-out\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c0713a2-f2d6-47e3-a640-499918b46949-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002724    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002753    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c0713a2-f2d6-47e3-a640-499918b46949-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-web-config\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.002860 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.003138 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002908    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c0713a2-f2d6-47e3-a640-499918b46949-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.003138 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.002932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.003507 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.003256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1c0713a2-f2d6-47e3-a640-499918b46949-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.003507 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.003480    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1c0713a2-f2d6-47e3-a640-499918b46949-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.003675 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.003614    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1c0713a2-f2d6-47e3-a640-499918b46949-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.006080 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.006043    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.007019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.006498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-config-volume\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.007019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.006589    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1c0713a2-f2d6-47e3-a640-499918b46949-config-out\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.007019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.006648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.007019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.006943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.007279 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.007026    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.007704 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.007673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-web-config\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.008056 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.008034    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1c0713a2-f2d6-47e3-a640-499918b46949-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.008148 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.008131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1c0713a2-f2d6-47e3-a640-499918b46949-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.010940 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.010919    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlgbm\" (UniqueName: \"kubernetes.io/projected/1c0713a2-f2d6-47e3-a640-499918b46949-kube-api-access-rlgbm\") pod \"alertmanager-main-0\" (UID: \"1c0713a2-f2d6-47e3-a640-499918b46949\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.075717 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.075650    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 14:56:54.405862 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.405827    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 14:56:54.409648 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:54.409625    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c0713a2_f2d6_47e3_a640_499918b46949.slice/crio-a90047b5d8dcf6dd52f9b5f897bac351ba0756891841272a1dbb8970b637dabe WatchSource:0}: Error finding container a90047b5d8dcf6dd52f9b5f897bac351ba0756891841272a1dbb8970b637dabe: Status 404 returned error can't find the container with id a90047b5d8dcf6dd52f9b5f897bac351ba0756891841272a1dbb8970b637dabe
Sep 08 14:56:54.660341 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.660279    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"]
Sep 08 14:56:54.662726 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.662710    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.665030 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665008    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 14:56:54.665114 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665010    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 14:56:54.665281 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665267    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l4h9n\""
Sep 08 14:56:54.665360 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665339    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 14:56:54.665406 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665361    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 14:56:54.665710 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665695    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-92mqgttsplfvn\""
Sep 08 14:56:54.665757 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.665696    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 14:56:54.668805 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.668786    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"]
Sep 08 14:56:54.810620 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwmm\" (UniqueName: \"kubernetes.io/projected/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-kube-api-access-cwwmm\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810650    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-metrics-client-ca\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810728    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-grpc-tls\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810827    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810865    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-tls\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.810896 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.810882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.842301 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.842272    2579 generic.go:356] "Generic (PLEG): container finished" podID="6cb09e40-7af6-426c-b29c-e26400b4fe39" containerID="c9d3f2d07803c3486855cb03ac4b347db037436baf82672d46889aa615fd9b13" exitCode=0
Sep 08 14:56:54.842385 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.842312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmzmb" event={"ID":"6cb09e40-7af6-426c-b29c-e26400b4fe39","Type":"ContainerDied","Data":"c9d3f2d07803c3486855cb03ac4b347db037436baf82672d46889aa615fd9b13"}
Sep 08 14:56:54.843805 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.843781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"a90047b5d8dcf6dd52f9b5f897bac351ba0756891841272a1dbb8970b637dabe"}
Sep 08 14:56:54.845849 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.845821    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6" event={"ID":"9a0c5c2a-2f29-469a-a3fe-9497e284a04c","Type":"ContainerStarted","Data":"30723b3f4d35f97998363914a32b3063358a342582fa84dafbbcf59b7d70d660"}
Sep 08 14:56:54.845903 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.845866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6" event={"ID":"9a0c5c2a-2f29-469a-a3fe-9497e284a04c","Type":"ContainerStarted","Data":"9b0885c57c1d45a97024859e5764c6252addf72220e3d9194c19f14e492d32b7"}
Sep 08 14:56:54.845903 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.845885    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6" event={"ID":"9a0c5c2a-2f29-469a-a3fe-9497e284a04c","Type":"ContainerStarted","Data":"31a444b434559196ae806b418cbeb15dc17bcde87d0532c9c0642c3abd00c0e2"}
Sep 08 14:56:54.911308 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911282    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-tls\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911423 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911423 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911360    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911728 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911686    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwmm\" (UniqueName: \"kubernetes.io/projected/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-kube-api-access-cwwmm\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-metrics-client-ca\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911834 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-grpc-tls\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.911992 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.911903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.913395 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.912603    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-metrics-client-ca\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.914215 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.914186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.914700 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.914657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-tls\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.914869 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.914841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.915582 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.915539    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.916003 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.915982    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.917186 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.917136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-secret-grpc-tls\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.922377 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.922333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwmm\" (UniqueName: \"kubernetes.io/projected/69cd3712-84f5-4b33-a2a8-4b2b92c30c03-kube-api-access-cwwmm\") pod \"thanos-querier-6bc9f976d8-ftqh2\" (UID: \"69cd3712-84f5-4b33-a2a8-4b2b92c30c03\") " pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:54.971991 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:54.971971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:56:55.261402 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.261313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"]
Sep 08 14:56:55.273582 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:55.273503    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69cd3712_84f5_4b33_a2a8_4b2b92c30c03.slice/crio-e98917be0e99256807a824ee51c6e5dfc6b065e1a89806469112e9c18a97054b WatchSource:0}: Error finding container e98917be0e99256807a824ee51c6e5dfc6b065e1a89806469112e9c18a97054b: Status 404 returned error can't find the container with id e98917be0e99256807a824ee51c6e5dfc6b065e1a89806469112e9c18a97054b
Sep 08 14:56:55.851518 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.851479    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmzmb" event={"ID":"6cb09e40-7af6-426c-b29c-e26400b4fe39","Type":"ContainerStarted","Data":"2c78ca9fb6a02335e17dd981b8049d77a48cf706b90efce8478b1b11b5e70607"}
Sep 08 14:56:55.851935 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.851546    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lmzmb" event={"ID":"6cb09e40-7af6-426c-b29c-e26400b4fe39","Type":"ContainerStarted","Data":"ca3b516f8c6c18f047d8471d97fb7855d4bd1d72c5de815233576c0304acb1e4"}
Sep 08 14:56:55.853750 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.853721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6" event={"ID":"9a0c5c2a-2f29-469a-a3fe-9497e284a04c","Type":"ContainerStarted","Data":"b3bcc96bf90a2a79f679c7e19b46c647e78a60f3d4f8e5869721a6b2f25e5be5"}
Sep 08 14:56:55.855053 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.855029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"e98917be0e99256807a824ee51c6e5dfc6b065e1a89806469112e9c18a97054b"}
Sep 08 14:56:55.870163 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.870119    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lmzmb" podStartSLOduration=2.701095172 podStartE2EDuration="3.87010532s" totalImagesPullingTime="1.105932796s" totalInitContainerRuntime="63.077352ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:55.868274501 +0000 UTC m=+107.015295409" watchObservedRunningTime="2026-09-08 14:56:55.87010532 +0000 UTC m=+107.017126224"
Sep 08 14:56:55.885334 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:55.885290    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-zbgf6" podStartSLOduration=2.781568292 podStartE2EDuration="3.885272272s" totalImagesPullingTime="1.10370398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:56:55.884888093 +0000 UTC m=+107.031908999" watchObservedRunningTime="2026-09-08 14:56:55.885272272 +0000 UTC m=+107.032293192"
Sep 08 14:56:56.859936 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.859907    2579 generic.go:356] "Generic (PLEG): container finished" podID="1c0713a2-f2d6-47e3-a640-499918b46949" containerID="0df16f78ce32e19c3681779341643f3700b3122987e49fa9f56929cd48354ca1" exitCode=0
Sep 08 14:56:56.860257 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.859991    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerDied","Data":"0df16f78ce32e19c3681779341643f3700b3122987e49fa9f56929cd48354ca1"}
Sep 08 14:56:56.971474 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.971435    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"]
Sep 08 14:56:56.973506 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.973490    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:56.976062 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.976018    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 14:56:56.976062 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.976060    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d92h1op1up7l0\""
Sep 08 14:56:56.976225 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.976061    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 14:56:56.976225 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.976063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 14:56:56.976225 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.976158    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 14:56:56.976344 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.976311    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-pbbrp\""
Sep 08 14:56:56.985840 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:56.984559    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"]
Sep 08 14:56:57.128680 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-secret-metrics-server-tls\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.128680 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-secret-metrics-server-client-certs\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.128680 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ddc774e3-961a-4daf-97a7-1163c74dce45-audit-log\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.128844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ddc774e3-961a-4daf-97a7-1163c74dce45-metrics-server-audit-profiles\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.128844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128761    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9db4\" (UniqueName: \"kubernetes.io/projected/ddc774e3-961a-4daf-97a7-1163c74dce45-kube-api-access-p9db4\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.128844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-client-ca-bundle\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.128844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.128819    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc774e3-961a-4daf-97a7-1163c74dce45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229701 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc774e3-961a-4daf-97a7-1163c74dce45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229801 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229722    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-secret-metrics-server-tls\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229801 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-secret-metrics-server-client-certs\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229801 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ddc774e3-961a-4daf-97a7-1163c74dce45-audit-log\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229801 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ddc774e3-961a-4daf-97a7-1163c74dce45-metrics-server-audit-profiles\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229993 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9db4\" (UniqueName: \"kubernetes.io/projected/ddc774e3-961a-4daf-97a7-1163c74dce45-kube-api-access-p9db4\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.229993 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.229820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-client-ca-bundle\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.230298 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.230264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ddc774e3-961a-4daf-97a7-1163c74dce45-audit-log\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.230476 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.230431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc774e3-961a-4daf-97a7-1163c74dce45-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.230770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.230750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ddc774e3-961a-4daf-97a7-1163c74dce45-metrics-server-audit-profiles\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.232360 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.232336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-secret-metrics-server-client-certs\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.232856 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.232834    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-client-ca-bundle\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.233021 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.232999    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ddc774e3-961a-4daf-97a7-1163c74dce45-secret-metrics-server-tls\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.237479 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.237443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9db4\" (UniqueName: \"kubernetes.io/projected/ddc774e3-961a-4daf-97a7-1163c74dce45-kube-api-access-p9db4\") pod \"metrics-server-5c97cd7bfd-v89pr\" (UID: \"ddc774e3-961a-4daf-97a7-1163c74dce45\") " pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.282858 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.282834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:56:57.565463 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.565044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"]
Sep 08 14:56:57.566901 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:56:57.566873    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc774e3_961a_4daf_97a7_1163c74dce45.slice/crio-77aa039a7e474a45856926107bf72fd8467dbff7fe101ccfb924b067a2ab9edb WatchSource:0}: Error finding container 77aa039a7e474a45856926107bf72fd8467dbff7fe101ccfb924b067a2ab9edb: Status 404 returned error can't find the container with id 77aa039a7e474a45856926107bf72fd8467dbff7fe101ccfb924b067a2ab9edb
Sep 08 14:56:57.865868 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:57.865786    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr" event={"ID":"ddc774e3-961a-4daf-97a7-1163c74dce45","Type":"ContainerStarted","Data":"77aa039a7e474a45856926107bf72fd8467dbff7fe101ccfb924b067a2ab9edb"}
Sep 08 14:56:58.872370 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:58.872343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"f91b1e6a5e754c0b019df92c6f81cb76316599c3f282482b0504615a56939052"}
Sep 08 14:56:58.872681 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:58.872424    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"8956ef56de021f3c48968cf8a5ab31d4e8833fa03d9db543fbbc440592c46c0c"}
Sep 08 14:56:59.878755 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:56:59.878724    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"48182ad24e1cda4e867aaa414d8eb3ef06d9670f162b5651bbed2807a4b3da35"}
Sep 08 14:57:00.886130 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.886088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"75340b91f596d6e947a3a15ad6644b9dcf6d113a1963721dcc4d367761067c1d"}
Sep 08 14:57:00.886586 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.886199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"74e610340f86c359b8a30327d3124935f05c2183ead6c044245b39de98bf0e88"}
Sep 08 14:57:00.886586 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.886236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:57:00.886586 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.886262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" event={"ID":"69cd3712-84f5-4b33-a2a8-4b2b92c30c03","Type":"ContainerStarted","Data":"652ba53bc37017af4e1fe8e2ce97f75416dfc69cb6cb32042dd1a7425de3507d"}
Sep 08 14:57:00.889557 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.889533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"ce49b9b852743f70784dce8f38c2d9d5285df17bff42b2ed2ed449a0a121c6db"}
Sep 08 14:57:00.889663 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.889586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"70586ee1d53a76fb25b2264eedf7413efb45789c4562a15f48170f39b131b767"}
Sep 08 14:57:00.889663 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.889610    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"3a5f268d0205726382044dbab971c4240fffcb4a63ced0a1803fc8ce3ee165c2"}
Sep 08 14:57:00.889663 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.889643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"21b3c2b2b1213fa75a566c3f302066ac1edabdb613c64973b425aac189c90638"}
Sep 08 14:57:00.889788 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.889672    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"6107ecc1ed9cdc5fbfa3b001bc942de163c9975e70ef55c56fdea8665eb7ec55"}
Sep 08 14:57:00.889788 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.889697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1c0713a2-f2d6-47e3-a640-499918b46949","Type":"ContainerStarted","Data":"f5f28b21899f332e85fff7a23eedb6d7c69371f268da6e5b72785af47dcb6c02"}
Sep 08 14:57:00.908874 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.908829    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2" podStartSLOduration=1.993632308 podStartE2EDuration="6.908814357s" totalImagesPullingTime="4.915182049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:00.906840078 +0000 UTC m=+112.053860984" watchObservedRunningTime="2026-09-08 14:57:00.908814357 +0000 UTC m=+112.055835263"
Sep 08 14:57:00.930693 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:00.930656    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.480698003 podStartE2EDuration="7.930644215s" totalImagesPullingTime="5.43424848s" totalInitContainerRuntime="15.697732ms" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:00.929825373 +0000 UTC m=+112.076846304" watchObservedRunningTime="2026-09-08 14:57:00.930644215 +0000 UTC m=+112.077665436"
Sep 08 14:57:02.899884 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:02.899850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr" event={"ID":"ddc774e3-961a-4daf-97a7-1163c74dce45","Type":"ContainerStarted","Data":"8dd784106e5b8be673b72849fd8537e51249d340f34043df320ae14a02d7cfcd"}
Sep 08 14:57:02.917527 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:02.917485    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr" podStartSLOduration=2.183879005 podStartE2EDuration="6.917469927s" totalImagesPullingTime="4.733590922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:02.916675679 +0000 UTC m=+114.063696629" watchObservedRunningTime="2026-09-08 14:57:02.917469927 +0000 UTC m=+114.064490846"
Sep 08 14:57:03.366990 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.366916    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-597448b5b-kntmp"]
Sep 08 14:57:03.431492 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.431436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-597448b5b-kntmp"]
Sep 08 14:57:03.431640 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.431546    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.438504 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.438481    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 14:57:03.483713 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483690    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-serving-cert\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.483839 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-config\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.483839 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-oauth-config\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.483931 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-service-ca\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.483931 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483894    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-oauth-serving-cert\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.483931 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdz5\" (UniqueName: \"kubernetes.io/projected/06fd371e-25d0-47d8-b7eb-e47c434827bc-kube-api-access-7pdz5\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.484044 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.483959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-trusted-ca-bundle\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584393 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdz5\" (UniqueName: \"kubernetes.io/projected/06fd371e-25d0-47d8-b7eb-e47c434827bc-kube-api-access-7pdz5\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-trusted-ca-bundle\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-serving-cert\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-config\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584480    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-oauth-config\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-service-ca\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.584548 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.584530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-oauth-serving-cert\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.585316 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.585288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-config\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.585404 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.585327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-oauth-serving-cert\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.585404 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.585335    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-service-ca\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.585404 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.585300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-trusted-ca-bundle\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.586822 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.586800    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-serving-cert\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.586822 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.586818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-oauth-config\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.592725 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.592705    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdz5\" (UniqueName: \"kubernetes.io/projected/06fd371e-25d0-47d8-b7eb-e47c434827bc-kube-api-access-7pdz5\") pod \"console-597448b5b-kntmp\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") " pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:03.742756 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:03.742729    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:04.031340 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:04.031317    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-597448b5b-kntmp"]
Sep 08 14:57:04.033397 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:57:04.033370    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06fd371e_25d0_47d8_b7eb_e47c434827bc.slice/crio-b4044f6e35f08c206aad68591f7596bb1214e1e707674c1963c78c76cda9142d WatchSource:0}: Error finding container b4044f6e35f08c206aad68591f7596bb1214e1e707674c1963c78c76cda9142d: Status 404 returned error can't find the container with id b4044f6e35f08c206aad68591f7596bb1214e1e707674c1963c78c76cda9142d
Sep 08 14:57:04.910384 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:04.910348    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597448b5b-kntmp" event={"ID":"06fd371e-25d0-47d8-b7eb-e47c434827bc","Type":"ContainerStarted","Data":"b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67"}
Sep 08 14:57:04.910582 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:04.910402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597448b5b-kntmp" event={"ID":"06fd371e-25d0-47d8-b7eb-e47c434827bc","Type":"ContainerStarted","Data":"b4044f6e35f08c206aad68591f7596bb1214e1e707674c1963c78c76cda9142d"}
Sep 08 14:57:04.927230 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:04.927181    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-597448b5b-kntmp" podStartSLOduration=1.927165716 podStartE2EDuration="1.927165716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:04.926558157 +0000 UTC m=+116.073579069" watchObservedRunningTime="2026-09-08 14:57:04.927165716 +0000 UTC m=+116.074186622"
Sep 08 14:57:06.902192 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:06.902160    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bc9f976d8-ftqh2"
Sep 08 14:57:13.743617 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:13.743563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:13.744027 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:13.743645    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:13.748426 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:13.748402    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:13.957208 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:13.957172    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:57:14.001894 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.001821    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7769c7444d-l92dg"]
Sep 08 14:57:14.613984 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.613924    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" podUID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" containerName="registry" containerID="cri-o://3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045" gracePeriod=30
Sep 08 14:57:14.855822 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.855800    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:57:14.877708 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877633    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngff7\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-kube-api-access-ngff7\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.877708 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877682    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-certificates\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.877882 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877739    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-installation-pull-secrets\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.877882 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-bound-sa-token\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.877882 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877807    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.877882 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877852    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-trusted-ca\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.878097 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-image-registry-private-configuration\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.878097 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.877921    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-ca-trust-extracted\") pod \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\" (UID: \"84eb2ac0-684f-4503-a3d8-175b2f93d3f6\") "
Sep 08 14:57:14.878192 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.878142    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:14.878874 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.878848    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:14.881056 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.881019    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:14.881200 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.881163    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:14.881475 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.881432    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:14.882006 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.881977    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-kube-api-access-ngff7" (OuterVolumeSpecName: "kube-api-access-ngff7") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "kube-api-access-ngff7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:14.882354 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.882327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:14.890655 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.890628    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "84eb2ac0-684f-4503-a3d8-175b2f93d3f6" (UID: "84eb2ac0-684f-4503-a3d8-175b2f93d3f6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:57:14.958007 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.957982    2579 generic.go:356] "Generic (PLEG): container finished" podID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" containerID="3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045" exitCode=0
Sep 08 14:57:14.958088 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.958024    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg"
Sep 08 14:57:14.958088 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.958061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" event={"ID":"84eb2ac0-684f-4503-a3d8-175b2f93d3f6","Type":"ContainerDied","Data":"3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045"}
Sep 08 14:57:14.958158 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.958128    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78cb84d85b-7hpxg" event={"ID":"84eb2ac0-684f-4503-a3d8-175b2f93d3f6","Type":"ContainerDied","Data":"e942c346ff75c23d64dd0fb44c4e7e0c7792994337e58560dca265bd51eeaa1b"}
Sep 08 14:57:14.958158 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.958149    2579 scope.go:117] "RemoveContainer" containerID="3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045"
Sep 08 14:57:14.966627 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.966611    2579 scope.go:117] "RemoveContainer" containerID="3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045"
Sep 08 14:57:14.966900 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:57:14.966877    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045\": container with ID starting with 3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045 not found: ID does not exist" containerID="3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045"
Sep 08 14:57:14.966970 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.966911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045"} err="failed to get container status \"3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045\": rpc error: code = NotFound desc = could not find container \"3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045\": container with ID starting with 3d11635df0f92dda445b4bfca378bc0ea578443b9f9c6588c7866bf73a02f045 not found: ID does not exist"
Sep 08 14:57:14.977784 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.977749    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78cb84d85b-7hpxg"]
Sep 08 14:57:14.979601 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979575    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngff7\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-kube-api-access-ngff7\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979605    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-certificates\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979622    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-installation-pull-secrets\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979637    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-bound-sa-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979652    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-registry-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979665    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-trusted-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979678    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-image-registry-private-configuration\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.979706 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.979690    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84eb2ac0-684f-4503-a3d8-175b2f93d3f6-ca-trust-extracted\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:14.981846 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:14.981826    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78cb84d85b-7hpxg"]
Sep 08 14:57:15.387317 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:15.387284    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" path="/var/lib/kubelet/pods/84eb2ac0-684f-4503-a3d8-175b2f93d3f6/volumes"
Sep 08 14:57:17.283971 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:17.283928    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:57:17.284349 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:17.283998    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:57:19.111432 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:19.111392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:57:19.113746 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:19.113725    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1fc94e5d-448a-4945-ae24-71f5170e623a-metrics-certs\") pod \"network-metrics-daemon-nv6hp\" (UID: \"1fc94e5d-448a-4945-ae24-71f5170e623a\") " pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:57:19.406461 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:19.406428    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4wbt\""
Sep 08 14:57:19.414716 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:19.414694    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nv6hp"
Sep 08 14:57:19.682126 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:19.682052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nv6hp"]
Sep 08 14:57:19.684931 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:57:19.684905    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc94e5d_448a_4945_ae24_71f5170e623a.slice/crio-922aca0e8aefaa641e2a68f43119bec3c13620b3257836014e0655efcfb866e1 WatchSource:0}: Error finding container 922aca0e8aefaa641e2a68f43119bec3c13620b3257836014e0655efcfb866e1: Status 404 returned error can't find the container with id 922aca0e8aefaa641e2a68f43119bec3c13620b3257836014e0655efcfb866e1
Sep 08 14:57:19.979594 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:19.979530    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nv6hp" event={"ID":"1fc94e5d-448a-4945-ae24-71f5170e623a","Type":"ContainerStarted","Data":"922aca0e8aefaa641e2a68f43119bec3c13620b3257836014e0655efcfb866e1"}
Sep 08 14:57:20.985693 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:20.985664    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nv6hp" event={"ID":"1fc94e5d-448a-4945-ae24-71f5170e623a","Type":"ContainerStarted","Data":"59f04285376aff142a238d3e15708e056633ed594bd88cf99261a200cfc27ef4"}
Sep 08 14:57:20.985972 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:20.985726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nv6hp" event={"ID":"1fc94e5d-448a-4945-ae24-71f5170e623a","Type":"ContainerStarted","Data":"a684e8c0b7b212a19c0df739ede9591d0d506b6c24410ba3e6d6de4a82699a4b"}
Sep 08 14:57:21.001232 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:21.001191    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nv6hp" podStartSLOduration=130.911382343 podStartE2EDuration="2m12.001176323s" totalImagesPullingTime="1.08979398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:57:21.000996566 +0000 UTC m=+132.148017700" watchObservedRunningTime="2026-09-08 14:57:21.001176323 +0000 UTC m=+132.148197280"
Sep 08 14:57:31.027892 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:31.027855    2579 generic.go:356] "Generic (PLEG): container finished" podID="732b7cf8-6646-4733-a491-e77fb719b00b" containerID="7633c97cd5e4ab2a8849acd7715d13113fc307cf45a967e917352170cf5fc75f" exitCode=0
Sep 08 14:57:31.028234 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:31.027932    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh" event={"ID":"732b7cf8-6646-4733-a491-e77fb719b00b","Type":"ContainerDied","Data":"7633c97cd5e4ab2a8849acd7715d13113fc307cf45a967e917352170cf5fc75f"}
Sep 08 14:57:31.028302 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:31.028250    2579 scope.go:117] "RemoveContainer" containerID="7633c97cd5e4ab2a8849acd7715d13113fc307cf45a967e917352170cf5fc75f"
Sep 08 14:57:32.032619 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:32.032590    2579 generic.go:356] "Generic (PLEG): container finished" podID="71db9847-e1f3-42dc-a9a6-1fb48e7e6624" containerID="f5eae8ec847ff0d4a41ecb281196ffad47b5b8bef6c8e8af6cf3892cd6ac54e5" exitCode=0
Sep 08 14:57:32.033034 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:32.032665    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5" event={"ID":"71db9847-e1f3-42dc-a9a6-1fb48e7e6624","Type":"ContainerDied","Data":"f5eae8ec847ff0d4a41ecb281196ffad47b5b8bef6c8e8af6cf3892cd6ac54e5"}
Sep 08 14:57:32.033034 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:32.032960    2579 scope.go:117] "RemoveContainer" containerID="f5eae8ec847ff0d4a41ecb281196ffad47b5b8bef6c8e8af6cf3892cd6ac54e5"
Sep 08 14:57:32.034690 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:32.034667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-bkcvh" event={"ID":"732b7cf8-6646-4733-a491-e77fb719b00b","Type":"ContainerStarted","Data":"d549358c5c4c7c0409b38542545934b6bd6c763f230a1a719fc2295ec45494cb"}
Sep 08 14:57:33.040994 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:33.040963    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-ngsg5" event={"ID":"71db9847-e1f3-42dc-a9a6-1fb48e7e6624","Type":"ContainerStarted","Data":"72e6dc16de8f8fee6f28ac15e6cf407ebb858cfe9115d6de2827e25aaab42d45"}
Sep 08 14:57:37.288349 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:37.288314    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:57:37.292552 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:37.292512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c97cd7bfd-v89pr"
Sep 08 14:57:39.027063 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.027028    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7769c7444d-l92dg" podUID="12bc6255-f9e7-4a66-acc3-abd83d390993" containerName="console" containerID="cri-o://1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3" gracePeriod=15
Sep 08 14:57:39.265671 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.265650    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:57:39.362352 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362263    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-serving-cert\") pod \"12bc6255-f9e7-4a66-acc3-abd83d390993\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") "
Sep 08 14:57:39.362352 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-console-config\") pod \"12bc6255-f9e7-4a66-acc3-abd83d390993\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") "
Sep 08 14:57:39.362352 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-oauth-config\") pod \"12bc6255-f9e7-4a66-acc3-abd83d390993\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") "
Sep 08 14:57:39.362640 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-service-ca\") pod \"12bc6255-f9e7-4a66-acc3-abd83d390993\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") "
Sep 08 14:57:39.362640 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362470    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-oauth-serving-cert\") pod \"12bc6255-f9e7-4a66-acc3-abd83d390993\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") "
Sep 08 14:57:39.362640 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362509    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmj5l\" (UniqueName: \"kubernetes.io/projected/12bc6255-f9e7-4a66-acc3-abd83d390993-kube-api-access-pmj5l\") pod \"12bc6255-f9e7-4a66-acc3-abd83d390993\" (UID: \"12bc6255-f9e7-4a66-acc3-abd83d390993\") "
Sep 08 14:57:39.362810 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362784    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-console-config" (OuterVolumeSpecName: "console-config") pod "12bc6255-f9e7-4a66-acc3-abd83d390993" (UID: "12bc6255-f9e7-4a66-acc3-abd83d390993"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:39.362853 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "12bc6255-f9e7-4a66-acc3-abd83d390993" (UID: "12bc6255-f9e7-4a66-acc3-abd83d390993"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:39.362910 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.362885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-service-ca" (OuterVolumeSpecName: "service-ca") pod "12bc6255-f9e7-4a66-acc3-abd83d390993" (UID: "12bc6255-f9e7-4a66-acc3-abd83d390993"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:57:39.364714 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.364687    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "12bc6255-f9e7-4a66-acc3-abd83d390993" (UID: "12bc6255-f9e7-4a66-acc3-abd83d390993"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:39.364812 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.364723    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "12bc6255-f9e7-4a66-acc3-abd83d390993" (UID: "12bc6255-f9e7-4a66-acc3-abd83d390993"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:57:39.364812 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.364736    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12bc6255-f9e7-4a66-acc3-abd83d390993-kube-api-access-pmj5l" (OuterVolumeSpecName: "kube-api-access-pmj5l") pod "12bc6255-f9e7-4a66-acc3-abd83d390993" (UID: "12bc6255-f9e7-4a66-acc3-abd83d390993"). InnerVolumeSpecName "kube-api-access-pmj5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:57:39.463809 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.463778    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmj5l\" (UniqueName: \"kubernetes.io/projected/12bc6255-f9e7-4a66-acc3-abd83d390993-kube-api-access-pmj5l\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:39.463809 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.463809    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:39.463967 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.463818    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-console-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:39.463967 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.463827    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/12bc6255-f9e7-4a66-acc3-abd83d390993-console-oauth-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:39.463967 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.463835    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:39.463967 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:39.463843    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/12bc6255-f9e7-4a66-acc3-abd83d390993-oauth-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:57:40.070760 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.070721    2579 generic.go:356] "Generic (PLEG): container finished" podID="12bc6255-f9e7-4a66-acc3-abd83d390993" containerID="1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3" exitCode=0
Sep 08 14:57:40.071125 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.070787    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7769c7444d-l92dg"
Sep 08 14:57:40.071125 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.070809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7769c7444d-l92dg" event={"ID":"12bc6255-f9e7-4a66-acc3-abd83d390993","Type":"ContainerDied","Data":"1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3"}
Sep 08 14:57:40.071125 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.070898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7769c7444d-l92dg" event={"ID":"12bc6255-f9e7-4a66-acc3-abd83d390993","Type":"ContainerDied","Data":"eb9eb7068d9684334f517d0c65a162e513f54da34c318d6c9fa84f8cde8943d2"}
Sep 08 14:57:40.071125 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.070924    2579 scope.go:117] "RemoveContainer" containerID="1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3"
Sep 08 14:57:40.078844 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.078823    2579 scope.go:117] "RemoveContainer" containerID="1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3"
Sep 08 14:57:40.079114 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:57:40.079091    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3\": container with ID starting with 1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3 not found: ID does not exist" containerID="1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3"
Sep 08 14:57:40.079176 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.079123    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3"} err="failed to get container status \"1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3\": rpc error: code = NotFound desc = could not find container \"1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3\": container with ID starting with 1738ef719ea21502fadc2433ecf77e198cc1eeee1fb7c3c579dbc95bd901eaa3 not found: ID does not exist"
Sep 08 14:57:40.086323 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.086301    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7769c7444d-l92dg"]
Sep 08 14:57:40.090220 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:40.090199    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7769c7444d-l92dg"]
Sep 08 14:57:41.387227 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:57:41.387194    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12bc6255-f9e7-4a66-acc3-abd83d390993" path="/var/lib/kubelet/pods/12bc6255-f9e7-4a66-acc3-abd83d390993/volumes"
Sep 08 14:58:22.299097 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299066    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bf44db7c8-lkr2t"]
Sep 08 14:58:22.299560 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299383    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" containerName="registry"
Sep 08 14:58:22.299560 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299394    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" containerName="registry"
Sep 08 14:58:22.299560 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299432    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12bc6255-f9e7-4a66-acc3-abd83d390993" containerName="console"
Sep 08 14:58:22.299560 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299438    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="12bc6255-f9e7-4a66-acc3-abd83d390993" containerName="console"
Sep 08 14:58:22.299560 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299500    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="84eb2ac0-684f-4503-a3d8-175b2f93d3f6" containerName="registry"
Sep 08 14:58:22.299560 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.299511    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="12bc6255-f9e7-4a66-acc3-abd83d390993" containerName="console"
Sep 08 14:58:22.302226 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.302181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.312871 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.312845    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf44db7c8-lkr2t"]
Sep 08 14:58:22.483121 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483094    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlhbj\" (UniqueName: \"kubernetes.io/projected/420f0acd-e908-4fcb-9e3e-585138fcb21a-kube-api-access-tlhbj\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.483121 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483125    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-serving-cert\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.483289 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-oauth-serving-cert\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.483289 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-config\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.483289 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-service-ca\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.483381 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-trusted-ca-bundle\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.483381 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.483362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-oauth-config\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.583929 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.583859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-serving-cert\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.583929 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.583900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-oauth-serving-cert\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584093 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.583936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-config\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584093 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.583978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-service-ca\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584093 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.584018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-trusted-ca-bundle\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584093 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.584057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-oauth-config\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584281 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.584095    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlhbj\" (UniqueName: \"kubernetes.io/projected/420f0acd-e908-4fcb-9e3e-585138fcb21a-kube-api-access-tlhbj\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584780 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.584753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-service-ca\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584894 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.584753    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-oauth-serving-cert\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.584894 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.584811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-config\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.585140 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.585113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-trusted-ca-bundle\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.586601 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.586574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-serving-cert\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.586684 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.586605    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-oauth-config\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.600168 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.600149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlhbj\" (UniqueName: \"kubernetes.io/projected/420f0acd-e908-4fcb-9e3e-585138fcb21a-kube-api-access-tlhbj\") pod \"console-5bf44db7c8-lkr2t\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") " pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.613020 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.613003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:22.881324 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:22.881256    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf44db7c8-lkr2t"]
Sep 08 14:58:22.884271 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:58:22.884238    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420f0acd_e908_4fcb_9e3e_585138fcb21a.slice/crio-6c647dcfd1aa09db20144ac6419432fe2dc4648daac82319949293979418014a WatchSource:0}: Error finding container 6c647dcfd1aa09db20144ac6419432fe2dc4648daac82319949293979418014a: Status 404 returned error can't find the container with id 6c647dcfd1aa09db20144ac6419432fe2dc4648daac82319949293979418014a
Sep 08 14:58:23.253394 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:23.253361    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf44db7c8-lkr2t" event={"ID":"420f0acd-e908-4fcb-9e3e-585138fcb21a","Type":"ContainerStarted","Data":"92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1"}
Sep 08 14:58:23.253589 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:23.253412    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf44db7c8-lkr2t" event={"ID":"420f0acd-e908-4fcb-9e3e-585138fcb21a","Type":"ContainerStarted","Data":"6c647dcfd1aa09db20144ac6419432fe2dc4648daac82319949293979418014a"}
Sep 08 14:58:23.274828 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:23.271196    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bf44db7c8-lkr2t" podStartSLOduration=1.271177335 podStartE2EDuration="1.271177335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:58:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:58:23.26872032 +0000 UTC m=+194.415741247" watchObservedRunningTime="2026-09-08 14:58:23.271177335 +0000 UTC m=+194.418198243"
Sep 08 14:58:32.614012 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:32.613975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:32.614389 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:32.614033    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:32.618612 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:32.618587    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:33.297473 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:33.297430    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 14:58:33.351005 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:33.350971    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-597448b5b-kntmp"]
Sep 08 14:58:58.370945 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.370881    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-597448b5b-kntmp" podUID="06fd371e-25d0-47d8-b7eb-e47c434827bc" containerName="console" containerID="cri-o://b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67" gracePeriod=15
Sep 08 14:58:58.615694 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.615668    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:58:58.749094 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749072    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-service-ca\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749253 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749113    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-serving-cert\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749253 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749137    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pdz5\" (UniqueName: \"kubernetes.io/projected/06fd371e-25d0-47d8-b7eb-e47c434827bc-kube-api-access-7pdz5\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749253 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749156    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-oauth-config\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749413 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-config\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749413 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-oauth-serving-cert\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749413 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749315    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-trusted-ca-bundle\") pod \"06fd371e-25d0-47d8-b7eb-e47c434827bc\" (UID: \"06fd371e-25d0-47d8-b7eb-e47c434827bc\") "
Sep 08 14:58:58.749667 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:58:58.749787 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749756    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:58:58.749872 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.749840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:58:58.750022 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.750000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-config" (OuterVolumeSpecName: "console-config") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:58:58.751348 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.751318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:58:58.751443 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.751371    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:58:58.751443 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.751378    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06fd371e-25d0-47d8-b7eb-e47c434827bc-kube-api-access-7pdz5" (OuterVolumeSpecName: "kube-api-access-7pdz5") pod "06fd371e-25d0-47d8-b7eb-e47c434827bc" (UID: "06fd371e-25d0-47d8-b7eb-e47c434827bc"). InnerVolumeSpecName "kube-api-access-7pdz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:58:58.849977 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.849954    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:58.849977 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.849974    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:58.850110 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.849984    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pdz5\" (UniqueName: \"kubernetes.io/projected/06fd371e-25d0-47d8-b7eb-e47c434827bc-kube-api-access-7pdz5\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:58.850110 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.849992    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-oauth-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:58.850110 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.850001    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-console-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:58.850110 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.850010    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-oauth-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:58.850110 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:58.850018    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06fd371e-25d0-47d8-b7eb-e47c434827bc-trusted-ca-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:58:59.402744 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.402717    2579 generic.go:356] "Generic (PLEG): container finished" podID="06fd371e-25d0-47d8-b7eb-e47c434827bc" containerID="b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67" exitCode=0
Sep 08 14:58:59.403064 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.402754    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-597448b5b-kntmp"
Sep 08 14:58:59.403064 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.402785    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597448b5b-kntmp" event={"ID":"06fd371e-25d0-47d8-b7eb-e47c434827bc","Type":"ContainerDied","Data":"b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67"}
Sep 08 14:58:59.403064 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.402819    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-597448b5b-kntmp" event={"ID":"06fd371e-25d0-47d8-b7eb-e47c434827bc","Type":"ContainerDied","Data":"b4044f6e35f08c206aad68591f7596bb1214e1e707674c1963c78c76cda9142d"}
Sep 08 14:58:59.403064 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.402838    2579 scope.go:117] "RemoveContainer" containerID="b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67"
Sep 08 14:58:59.410757 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.410741    2579 scope.go:117] "RemoveContainer" containerID="b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67"
Sep 08 14:58:59.411025 ip-10-0-137-101 kubenswrapper[2579]: E0908 14:58:59.411007    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67\": container with ID starting with b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67 not found: ID does not exist" containerID="b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67"
Sep 08 14:58:59.411071 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.411033    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67"} err="failed to get container status \"b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67\": rpc error: code = NotFound desc = could not find container \"b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67\": container with ID starting with b73a300526cecbad77907c0cd96146f4d582bfccd991dc3d72aa115c52b55d67 not found: ID does not exist"
Sep 08 14:58:59.418059 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.418038    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-597448b5b-kntmp"]
Sep 08 14:58:59.421046 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:58:59.421023    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-597448b5b-kntmp"]
Sep 08 14:59:01.386563 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.386525    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06fd371e-25d0-47d8-b7eb-e47c434827bc" path="/var/lib/kubelet/pods/06fd371e-25d0-47d8-b7eb-e47c434827bc/volumes"
Sep 08 14:59:01.459705 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.459674    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"]
Sep 08 14:59:01.459973 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.459961    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06fd371e-25d0-47d8-b7eb-e47c434827bc" containerName="console"
Sep 08 14:59:01.460024 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.459975    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="06fd371e-25d0-47d8-b7eb-e47c434827bc" containerName="console"
Sep 08 14:59:01.460061 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.460038    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="06fd371e-25d0-47d8-b7eb-e47c434827bc" containerName="console"
Sep 08 14:59:01.463089 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.463074    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.465305 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.465286    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:59:01.466019 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.466000    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:59:01.466128 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.466038    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rwgp9\""
Sep 08 14:59:01.471718 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.471696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"]
Sep 08 14:59:01.573103 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.573079    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw5f7\" (UniqueName: \"kubernetes.io/projected/3b02ba28-66c3-4576-bc46-fd757681f8d1-kube-api-access-mw5f7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.573220 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.573126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.573220 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.573144    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.673903 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.673881    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw5f7\" (UniqueName: \"kubernetes.io/projected/3b02ba28-66c3-4576-bc46-fd757681f8d1-kube-api-access-mw5f7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.674033 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.674014    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.674076 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.674041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.674345 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.674329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.674382 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.674357    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.681736 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.681714    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw5f7\" (UniqueName: \"kubernetes.io/projected/3b02ba28-66c3-4576-bc46-fd757681f8d1-kube-api-access-mw5f7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:01.772319 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:01.772295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:02.039939 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:02.039895    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"]
Sep 08 14:59:02.042478 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:59:02.042440    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b02ba28_66c3_4576_bc46_fd757681f8d1.slice/crio-7d6446d84c13c5b25046bf9b92593f1fc6832c8fb600bcfe740b21c21e7bc0c9 WatchSource:0}: Error finding container 7d6446d84c13c5b25046bf9b92593f1fc6832c8fb600bcfe740b21c21e7bc0c9: Status 404 returned error can't find the container with id 7d6446d84c13c5b25046bf9b92593f1fc6832c8fb600bcfe740b21c21e7bc0c9
Sep 08 14:59:02.416587 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:02.416555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg" event={"ID":"3b02ba28-66c3-4576-bc46-fd757681f8d1","Type":"ContainerStarted","Data":"7d6446d84c13c5b25046bf9b92593f1fc6832c8fb600bcfe740b21c21e7bc0c9"}
Sep 08 14:59:08.445369 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:08.445333    2579 generic.go:356] "Generic (PLEG): container finished" podID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerID="9990ec85cddc4b2c25ed741cafa805ebb57354e41b43467775c882abcadfd073" exitCode=0
Sep 08 14:59:08.445736 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:08.445401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg" event={"ID":"3b02ba28-66c3-4576-bc46-fd757681f8d1","Type":"ContainerDied","Data":"9990ec85cddc4b2c25ed741cafa805ebb57354e41b43467775c882abcadfd073"}
Sep 08 14:59:26.516243 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:26.516210    2579 generic.go:356] "Generic (PLEG): container finished" podID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerID="ea0f3e8fb195334816c733257ec4473f111cd65b71edd6b70114ed6e7262646f" exitCode=0
Sep 08 14:59:26.516644 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:26.516255    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg" event={"ID":"3b02ba28-66c3-4576-bc46-fd757681f8d1","Type":"ContainerDied","Data":"ea0f3e8fb195334816c733257ec4473f111cd65b71edd6b70114ed6e7262646f"}
Sep 08 14:59:33.549894 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:33.549857    2579 generic.go:356] "Generic (PLEG): container finished" podID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerID="07e326c09d8ecdf51865c6d0f8401c1b3909c78b43e12809de7e6d5132d0184c" exitCode=0
Sep 08 14:59:33.550283 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:33.549901    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg" event={"ID":"3b02ba28-66c3-4576-bc46-fd757681f8d1","Type":"ContainerDied","Data":"07e326c09d8ecdf51865c6d0f8401c1b3909c78b43e12809de7e6d5132d0184c"}
Sep 08 14:59:34.668842 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.668819    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:34.727594 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.727567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-bundle\") pod \"3b02ba28-66c3-4576-bc46-fd757681f8d1\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") "
Sep 08 14:59:34.727723 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.727609    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mw5f7\" (UniqueName: \"kubernetes.io/projected/3b02ba28-66c3-4576-bc46-fd757681f8d1-kube-api-access-mw5f7\") pod \"3b02ba28-66c3-4576-bc46-fd757681f8d1\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") "
Sep 08 14:59:34.727723 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.727625    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-util\") pod \"3b02ba28-66c3-4576-bc46-fd757681f8d1\" (UID: \"3b02ba28-66c3-4576-bc46-fd757681f8d1\") "
Sep 08 14:59:34.728206 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.728182    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-bundle" (OuterVolumeSpecName: "bundle") pod "3b02ba28-66c3-4576-bc46-fd757681f8d1" (UID: "3b02ba28-66c3-4576-bc46-fd757681f8d1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:59:34.729740 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.729717    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b02ba28-66c3-4576-bc46-fd757681f8d1-kube-api-access-mw5f7" (OuterVolumeSpecName: "kube-api-access-mw5f7") pod "3b02ba28-66c3-4576-bc46-fd757681f8d1" (UID: "3b02ba28-66c3-4576-bc46-fd757681f8d1"). InnerVolumeSpecName "kube-api-access-mw5f7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:59:34.732529 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.732508    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-util" (OuterVolumeSpecName: "util") pod "3b02ba28-66c3-4576-bc46-fd757681f8d1" (UID: "3b02ba28-66c3-4576-bc46-fd757681f8d1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:59:34.828655 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.828600    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:59:34.828655 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.828623    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw5f7\" (UniqueName: \"kubernetes.io/projected/3b02ba28-66c3-4576-bc46-fd757681f8d1-kube-api-access-mw5f7\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:59:34.828655 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:34.828638    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3b02ba28-66c3-4576-bc46-fd757681f8d1-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:59:35.559383 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:35.559358    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg"
Sep 08 14:59:35.559535 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:35.559356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540stffg" event={"ID":"3b02ba28-66c3-4576-bc46-fd757681f8d1","Type":"ContainerDied","Data":"7d6446d84c13c5b25046bf9b92593f1fc6832c8fb600bcfe740b21c21e7bc0c9"}
Sep 08 14:59:35.559535 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:35.559491    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d6446d84c13c5b25046bf9b92593f1fc6832c8fb600bcfe740b21c21e7bc0c9"
Sep 08 14:59:39.621418 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621384    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"]
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621666    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="extract"
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621677    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="extract"
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621686    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="util"
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621692    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="util"
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621709    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="pull"
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621714    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="pull"
Sep 08 14:59:39.621770 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.621766    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b02ba28-66c3-4576-bc46-fd757681f8d1" containerName="extract"
Sep 08 14:59:39.623857 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.623838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.626885 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.626865    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 14:59:39.627127 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.627105    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-krmff\""
Sep 08 14:59:39.627237 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.627172    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:59:39.640026 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.640005    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"]
Sep 08 14:59:39.659743 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.659716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/562311d9-cca2-49d6-8bc6-67ba51214fc1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vtm4z\" (UID: \"562311d9-cca2-49d6-8bc6-67ba51214fc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.659826 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.659772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jwb\" (UniqueName: \"kubernetes.io/projected/562311d9-cca2-49d6-8bc6-67ba51214fc1-kube-api-access-n8jwb\") pod \"cert-manager-operator-controller-manager-55c444bf86-vtm4z\" (UID: \"562311d9-cca2-49d6-8bc6-67ba51214fc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.760577 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.760554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jwb\" (UniqueName: \"kubernetes.io/projected/562311d9-cca2-49d6-8bc6-67ba51214fc1-kube-api-access-n8jwb\") pod \"cert-manager-operator-controller-manager-55c444bf86-vtm4z\" (UID: \"562311d9-cca2-49d6-8bc6-67ba51214fc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.760668 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.760600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/562311d9-cca2-49d6-8bc6-67ba51214fc1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vtm4z\" (UID: \"562311d9-cca2-49d6-8bc6-67ba51214fc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.760918 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.760902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/562311d9-cca2-49d6-8bc6-67ba51214fc1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vtm4z\" (UID: \"562311d9-cca2-49d6-8bc6-67ba51214fc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.768125 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.768106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jwb\" (UniqueName: \"kubernetes.io/projected/562311d9-cca2-49d6-8bc6-67ba51214fc1-kube-api-access-n8jwb\") pod \"cert-manager-operator-controller-manager-55c444bf86-vtm4z\" (UID: \"562311d9-cca2-49d6-8bc6-67ba51214fc1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:39.932804 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:39.932785    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"
Sep 08 14:59:40.212937 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:40.212911    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z"]
Sep 08 14:59:40.215203 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:59:40.215171    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562311d9_cca2_49d6_8bc6_67ba51214fc1.slice/crio-ca0af5426718ff2118b04b57e81ef0c2f74229bed229245f48b2bdb4fb5d540b WatchSource:0}: Error finding container ca0af5426718ff2118b04b57e81ef0c2f74229bed229245f48b2bdb4fb5d540b: Status 404 returned error can't find the container with id ca0af5426718ff2118b04b57e81ef0c2f74229bed229245f48b2bdb4fb5d540b
Sep 08 14:59:40.581338 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:40.581263    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z" event={"ID":"562311d9-cca2-49d6-8bc6-67ba51214fc1","Type":"ContainerStarted","Data":"ca0af5426718ff2118b04b57e81ef0c2f74229bed229245f48b2bdb4fb5d540b"}
Sep 08 14:59:42.591657 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:42.591626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z" event={"ID":"562311d9-cca2-49d6-8bc6-67ba51214fc1","Type":"ContainerStarted","Data":"b1ddcdf679081c33c591e674e2c19419ff7a1248bc9f2e20c4fb55a3c73bc6cd"}
Sep 08 14:59:42.613505 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:42.613420    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vtm4z" podStartSLOduration=1.924388733 podStartE2EDuration="3.613389706s" totalImagesPullingTime="1.689000973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:59:42.610399211 +0000 UTC m=+273.757420147" watchObservedRunningTime="2026-09-08 14:59:42.613389706 +0000 UTC m=+273.760410614"
Sep 08 14:59:43.674262 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.674227    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"]
Sep 08 14:59:43.676623 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.676607    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.678936 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.678911    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 14:59:43.679040 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.679011    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 14:59:43.679634 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.679617    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rwgp9\""
Sep 08 14:59:43.685061 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.685036    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"]
Sep 08 14:59:43.686290 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.686270    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.686384 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.686303    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbpn7\" (UniqueName: \"kubernetes.io/projected/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-kube-api-access-tbpn7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.686384 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.686322    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.786919 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.786884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.786919 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.786924    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbpn7\" (UniqueName: \"kubernetes.io/projected/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-kube-api-access-tbpn7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.787160 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.786943    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.787290 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.787272    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.787364 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.787321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.806008 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.805985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbpn7\" (UniqueName: \"kubernetes.io/projected/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-kube-api-access-tbpn7\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:43.985697 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:43.985610    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:44.257269 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:44.257185    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"]
Sep 08 14:59:44.267750 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:59:44.267722    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9bfb3d_c433_4bcd_ab2b_cfdf6193e8e9.slice/crio-062495be8e07af85a7c319171b80075346fb9d9566f596eb16b75f2a0e1855ee WatchSource:0}: Error finding container 062495be8e07af85a7c319171b80075346fb9d9566f596eb16b75f2a0e1855ee: Status 404 returned error can't find the container with id 062495be8e07af85a7c319171b80075346fb9d9566f596eb16b75f2a0e1855ee
Sep 08 14:59:44.601432 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:44.601364    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerID="4a617baa780f747a72fa0bfbc4cdca7c4f81b113e6005d324768005c2d1344ff" exitCode=0
Sep 08 14:59:44.601432 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:44.601402    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb" event={"ID":"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9","Type":"ContainerDied","Data":"4a617baa780f747a72fa0bfbc4cdca7c4f81b113e6005d324768005c2d1344ff"}
Sep 08 14:59:44.601646 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:44.601472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb" event={"ID":"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9","Type":"ContainerStarted","Data":"062495be8e07af85a7c319171b80075346fb9d9566f596eb16b75f2a0e1855ee"}
Sep 08 14:59:45.073916 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.073887    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wknts"]
Sep 08 14:59:45.076028 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.076012    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.078357 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.078330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 14:59:45.078502 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.078388    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 14:59:45.078558 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.078528    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-t4lhs\""
Sep 08 14:59:45.086861 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.086840    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wknts"]
Sep 08 14:59:45.095258 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.095229    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a859fd6d-eb65-4944-9120-c5455a812a33-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wknts\" (UID: \"a859fd6d-eb65-4944-9120-c5455a812a33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.095345 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.095329    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khmkr\" (UniqueName: \"kubernetes.io/projected/a859fd6d-eb65-4944-9120-c5455a812a33-kube-api-access-khmkr\") pod \"cert-manager-webhook-6486ffd997-wknts\" (UID: \"a859fd6d-eb65-4944-9120-c5455a812a33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.186475 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.186434    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"]
Sep 08 14:59:45.188800 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.188782    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.191254 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.191224    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2v6bs\""
Sep 08 14:59:45.195872 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.195851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khmkr\" (UniqueName: \"kubernetes.io/projected/a859fd6d-eb65-4944-9120-c5455a812a33-kube-api-access-khmkr\") pod \"cert-manager-webhook-6486ffd997-wknts\" (UID: \"a859fd6d-eb65-4944-9120-c5455a812a33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.195976 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.195899    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47ee34cb-d7ce-439e-9279-2ca158eb8fe0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nrm4f\" (UID: \"47ee34cb-d7ce-439e-9279-2ca158eb8fe0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.195976 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.195924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrf2k\" (UniqueName: \"kubernetes.io/projected/47ee34cb-d7ce-439e-9279-2ca158eb8fe0-kube-api-access-rrf2k\") pod \"cert-manager-cainjector-559cdd8c87-nrm4f\" (UID: \"47ee34cb-d7ce-439e-9279-2ca158eb8fe0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.196091 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.196017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a859fd6d-eb65-4944-9120-c5455a812a33-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wknts\" (UID: \"a859fd6d-eb65-4944-9120-c5455a812a33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.199209 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.199185    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"]
Sep 08 14:59:45.205378 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.205355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khmkr\" (UniqueName: \"kubernetes.io/projected/a859fd6d-eb65-4944-9120-c5455a812a33-kube-api-access-khmkr\") pod \"cert-manager-webhook-6486ffd997-wknts\" (UID: \"a859fd6d-eb65-4944-9120-c5455a812a33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.208067 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.208042    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a859fd6d-eb65-4944-9120-c5455a812a33-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wknts\" (UID: \"a859fd6d-eb65-4944-9120-c5455a812a33\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.296574 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.296543    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47ee34cb-d7ce-439e-9279-2ca158eb8fe0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nrm4f\" (UID: \"47ee34cb-d7ce-439e-9279-2ca158eb8fe0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.296722 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.296586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrf2k\" (UniqueName: \"kubernetes.io/projected/47ee34cb-d7ce-439e-9279-2ca158eb8fe0-kube-api-access-rrf2k\") pod \"cert-manager-cainjector-559cdd8c87-nrm4f\" (UID: \"47ee34cb-d7ce-439e-9279-2ca158eb8fe0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.304758 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.304733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrf2k\" (UniqueName: \"kubernetes.io/projected/47ee34cb-d7ce-439e-9279-2ca158eb8fe0-kube-api-access-rrf2k\") pod \"cert-manager-cainjector-559cdd8c87-nrm4f\" (UID: \"47ee34cb-d7ce-439e-9279-2ca158eb8fe0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.304875 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.304733    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47ee34cb-d7ce-439e-9279-2ca158eb8fe0-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nrm4f\" (UID: \"47ee34cb-d7ce-439e-9279-2ca158eb8fe0\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.396037 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.396014    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:45.500911 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.500881    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"
Sep 08 14:59:45.675738 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.675705    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wknts"]
Sep 08 14:59:45.678027 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:59:45.677995    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda859fd6d_eb65_4944_9120_c5455a812a33.slice/crio-52637a26602d1d05520103859286e63a31c3f42a59f9af9a992216e4bbf76773 WatchSource:0}: Error finding container 52637a26602d1d05520103859286e63a31c3f42a59f9af9a992216e4bbf76773: Status 404 returned error can't find the container with id 52637a26602d1d05520103859286e63a31c3f42a59f9af9a992216e4bbf76773
Sep 08 14:59:45.779856 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:45.779830    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f"]
Sep 08 14:59:46.368864 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:59:46.368827    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47ee34cb_d7ce_439e_9279_2ca158eb8fe0.slice/crio-dd0330c1ad2e41f3274d9cfb4e0f7ac4b6a00355d4f19991fd69a8d52d19566d WatchSource:0}: Error finding container dd0330c1ad2e41f3274d9cfb4e0f7ac4b6a00355d4f19991fd69a8d52d19566d: Status 404 returned error can't find the container with id dd0330c1ad2e41f3274d9cfb4e0f7ac4b6a00355d4f19991fd69a8d52d19566d
Sep 08 14:59:46.612408 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:46.612376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts" event={"ID":"a859fd6d-eb65-4944-9120-c5455a812a33","Type":"ContainerStarted","Data":"52637a26602d1d05520103859286e63a31c3f42a59f9af9a992216e4bbf76773"}
Sep 08 14:59:46.613519 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:46.613499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f" event={"ID":"47ee34cb-d7ce-439e-9279-2ca158eb8fe0","Type":"ContainerStarted","Data":"dd0330c1ad2e41f3274d9cfb4e0f7ac4b6a00355d4f19991fd69a8d52d19566d"}
Sep 08 14:59:47.623864 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:47.623833    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerID="81e6fbb2e068965e44ad96dc8d63da2855dc8c69184fc69431be3b39a2e3d8cf" exitCode=0
Sep 08 14:59:47.624247 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:47.623898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb" event={"ID":"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9","Type":"ContainerDied","Data":"81e6fbb2e068965e44ad96dc8d63da2855dc8c69184fc69431be3b39a2e3d8cf"}
Sep 08 14:59:48.632692 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:48.632653    2579 generic.go:356] "Generic (PLEG): container finished" podID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerID="8a8f4747ad94c8daf37128d60bc164e9dccc39327790cde964da31a4bc1d4df0" exitCode=0
Sep 08 14:59:48.633143 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:48.632714    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb" event={"ID":"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9","Type":"ContainerDied","Data":"8a8f4747ad94c8daf37128d60bc164e9dccc39327790cde964da31a4bc1d4df0"}
Sep 08 14:59:49.768816 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.768789    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:49.828809 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.828784    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-bundle\") pod \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") "
Sep 08 14:59:49.828913 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.828851    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbpn7\" (UniqueName: \"kubernetes.io/projected/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-kube-api-access-tbpn7\") pod \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") "
Sep 08 14:59:49.828913 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.828891    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-util\") pod \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\" (UID: \"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9\") "
Sep 08 14:59:49.829187 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.829157    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-bundle" (OuterVolumeSpecName: "bundle") pod "ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" (UID: "ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:59:49.830958 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.830938    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-kube-api-access-tbpn7" (OuterVolumeSpecName: "kube-api-access-tbpn7") pod "ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" (UID: "ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9"). InnerVolumeSpecName "kube-api-access-tbpn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:59:49.833002 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.832979    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-util" (OuterVolumeSpecName: "util") pod "ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" (UID: "ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:59:49.929748 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.929718    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbpn7\" (UniqueName: \"kubernetes.io/projected/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-kube-api-access-tbpn7\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:59:49.929849 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.929750    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:59:49.929849 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:49.929765    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 14:59:50.645632 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.645599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts" event={"ID":"a859fd6d-eb65-4944-9120-c5455a812a33","Type":"ContainerStarted","Data":"aacbfbd24eb144682506ab4d89da965a5b62afb35affe3d4b0eb129bbfc701c1"}
Sep 08 14:59:50.645817 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.645653    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 14:59:50.647142 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.647112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f" event={"ID":"47ee34cb-d7ce-439e-9279-2ca158eb8fe0","Type":"ContainerStarted","Data":"8922b57e01eb39ee580a2c7a80396e883d5e6753f0dd43e01e32ce4a3e201020"}
Sep 08 14:59:50.649084 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.649062    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb"
Sep 08 14:59:50.649084 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.649077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f2q2nb" event={"ID":"ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9","Type":"ContainerDied","Data":"062495be8e07af85a7c319171b80075346fb9d9566f596eb16b75f2a0e1855ee"}
Sep 08 14:59:50.649191 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.649107    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="062495be8e07af85a7c319171b80075346fb9d9566f596eb16b75f2a0e1855ee"
Sep 08 14:59:50.662146 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.662110    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts" podStartSLOduration=1.495907781 podStartE2EDuration="5.66209827s" totalImagesPullingTime="4.166190489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:59:50.661219853 +0000 UTC m=+281.808240759" watchObservedRunningTime="2026-09-08 14:59:50.66209827 +0000 UTC m=+281.809119176"
Sep 08 14:59:50.677161 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:50.677124    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nrm4f" podStartSLOduration=2.211486029 podStartE2EDuration="5.677109649s" totalImagesPullingTime="3.46562362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:59:50.675636445 +0000 UTC m=+281.822657352" watchObservedRunningTime="2026-09-08 14:59:50.677109649 +0000 UTC m=+281.824130556"
Sep 08 14:59:52.991052 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991014    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-24wn8"]
Sep 08 14:59:52.991438 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991353    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="pull"
Sep 08 14:59:52.991438 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991366    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="pull"
Sep 08 14:59:52.991438 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991384    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="extract"
Sep 08 14:59:52.991438 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991391    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="extract"
Sep 08 14:59:52.991438 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991400    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="util"
Sep 08 14:59:52.991438 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991405    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="util"
Sep 08 14:59:52.991680 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.991477    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff9bfb3d-c433-4bcd-ab2b-cfdf6193e8e9" containerName="extract"
Sep 08 14:59:52.993546 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.993527    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:52.995542 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:52.995514    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-67hhq\""
Sep 08 14:59:53.001625 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.001597    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-24wn8"]
Sep 08 14:59:53.053749 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.053726    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6m8\" (UniqueName: \"kubernetes.io/projected/542473ab-f88a-4515-b99d-449e4d32dbca-kube-api-access-zb6m8\") pod \"cert-manager-55b4d954d5-24wn8\" (UID: \"542473ab-f88a-4515-b99d-449e4d32dbca\") " pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.053843 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.053769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/542473ab-f88a-4515-b99d-449e4d32dbca-bound-sa-token\") pod \"cert-manager-55b4d954d5-24wn8\" (UID: \"542473ab-f88a-4515-b99d-449e4d32dbca\") " pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.154644 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.154616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6m8\" (UniqueName: \"kubernetes.io/projected/542473ab-f88a-4515-b99d-449e4d32dbca-kube-api-access-zb6m8\") pod \"cert-manager-55b4d954d5-24wn8\" (UID: \"542473ab-f88a-4515-b99d-449e4d32dbca\") " pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.154757 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.154659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/542473ab-f88a-4515-b99d-449e4d32dbca-bound-sa-token\") pod \"cert-manager-55b4d954d5-24wn8\" (UID: \"542473ab-f88a-4515-b99d-449e4d32dbca\") " pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.163127 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.163093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/542473ab-f88a-4515-b99d-449e4d32dbca-bound-sa-token\") pod \"cert-manager-55b4d954d5-24wn8\" (UID: \"542473ab-f88a-4515-b99d-449e4d32dbca\") " pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.163231 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.163215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6m8\" (UniqueName: \"kubernetes.io/projected/542473ab-f88a-4515-b99d-449e4d32dbca-kube-api-access-zb6m8\") pod \"cert-manager-55b4d954d5-24wn8\" (UID: \"542473ab-f88a-4515-b99d-449e4d32dbca\") " pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.303085 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.303032    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-24wn8"
Sep 08 14:59:53.573242 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.573040    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-24wn8"]
Sep 08 14:59:53.575877 ip-10-0-137-101 kubenswrapper[2579]: W0908 14:59:53.575856    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod542473ab_f88a_4515_b99d_449e4d32dbca.slice/crio-660a41ae5133981f32080e7e64d989788e3a7b9cf975c43777746267a9747452 WatchSource:0}: Error finding container 660a41ae5133981f32080e7e64d989788e3a7b9cf975c43777746267a9747452: Status 404 returned error can't find the container with id 660a41ae5133981f32080e7e64d989788e3a7b9cf975c43777746267a9747452
Sep 08 14:59:53.664312 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.664275    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-24wn8" event={"ID":"542473ab-f88a-4515-b99d-449e4d32dbca","Type":"ContainerStarted","Data":"2cae733e65c26d8f152e5dab9f5b24dfec900e28a46ae1459b5c88544fea9571"}
Sep 08 14:59:53.664433 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.664335    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-24wn8" event={"ID":"542473ab-f88a-4515-b99d-449e4d32dbca","Type":"ContainerStarted","Data":"660a41ae5133981f32080e7e64d989788e3a7b9cf975c43777746267a9747452"}
Sep 08 14:59:53.681028 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:53.680982    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-24wn8" podStartSLOduration=1.6809681410000001 podStartE2EDuration="1.680968141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:59:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:59:53.679499514 +0000 UTC m=+284.826520421" watchObservedRunningTime="2026-09-08 14:59:53.680968141 +0000 UTC m=+284.827989048"
Sep 08 14:59:56.655809 ip-10-0-137-101 kubenswrapper[2579]: I0908 14:59:56.655776    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wknts"
Sep 08 15:00:04.890556 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.890524    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"]
Sep 08 15:00:04.895477 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.895156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:04.898273 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.898252    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rwgp9\""
Sep 08 15:00:04.898400 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.898277    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:00:04.898769 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.898751    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:00:04.902557 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.902533    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"]
Sep 08 15:00:04.941275 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.941251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:04.941390 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.941295    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxwlf\" (UniqueName: \"kubernetes.io/projected/79780808-3547-4507-976d-2be324146a55-kube-api-access-xxwlf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:04.941390 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:04.941357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.042185 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.042160    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxwlf\" (UniqueName: \"kubernetes.io/projected/79780808-3547-4507-976d-2be324146a55-kube-api-access-xxwlf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.042277 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.042197    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.042277 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.042241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.042587 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.042571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.042630 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.042613    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.050571 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.050542    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxwlf\" (UniqueName: \"kubernetes.io/projected/79780808-3547-4507-976d-2be324146a55-kube-api-access-xxwlf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv\" (UID: \"79780808-3547-4507-976d-2be324146a55\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.207178 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.207117    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:05.478954 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.478905    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"]
Sep 08 15:00:05.481114 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:00:05.481085    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79780808_3547_4507_976d_2be324146a55.slice/crio-1116fd203d75c322b29781335b155f87ac58cd58af57725c3fb8d0d39915ec6b WatchSource:0}: Error finding container 1116fd203d75c322b29781335b155f87ac58cd58af57725c3fb8d0d39915ec6b: Status 404 returned error can't find the container with id 1116fd203d75c322b29781335b155f87ac58cd58af57725c3fb8d0d39915ec6b
Sep 08 15:00:05.717024 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.716998    2579 generic.go:356] "Generic (PLEG): container finished" podID="79780808-3547-4507-976d-2be324146a55" containerID="b32d6229a83bf3383e9490db17eb1f41241f2fffae159a5a1ba2656c93d968ca" exitCode=0
Sep 08 15:00:05.717153 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.717064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv" event={"ID":"79780808-3547-4507-976d-2be324146a55","Type":"ContainerDied","Data":"b32d6229a83bf3383e9490db17eb1f41241f2fffae159a5a1ba2656c93d968ca"}
Sep 08 15:00:05.717153 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:05.717100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv" event={"ID":"79780808-3547-4507-976d-2be324146a55","Type":"ContainerStarted","Data":"1116fd203d75c322b29781335b155f87ac58cd58af57725c3fb8d0d39915ec6b"}
Sep 08 15:00:09.218799 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.218776    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:00:09.219202 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.218953    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:00:09.224867 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.224826    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:00:09.225540 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.225480    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:00:09.234955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.234932    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:00:09.736801 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.736769    2579 generic.go:356] "Generic (PLEG): container finished" podID="79780808-3547-4507-976d-2be324146a55" containerID="097165146fad968b1b342b06b5aa3f79783cfd7523e8c658a752ec19981a95b9" exitCode=0
Sep 08 15:00:09.738167 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:09.736812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv" event={"ID":"79780808-3547-4507-976d-2be324146a55","Type":"ContainerDied","Data":"097165146fad968b1b342b06b5aa3f79783cfd7523e8c658a752ec19981a95b9"}
Sep 08 15:00:10.743532 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:10.743503    2579 generic.go:356] "Generic (PLEG): container finished" podID="79780808-3547-4507-976d-2be324146a55" containerID="f60781bec7d6be281788e78f21014f537a670a0d839634ef8d921f2860d03e74" exitCode=0
Sep 08 15:00:10.743913 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:10.743539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv" event={"ID":"79780808-3547-4507-976d-2be324146a55","Type":"ContainerDied","Data":"f60781bec7d6be281788e78f21014f537a670a0d839634ef8d921f2860d03e74"}
Sep 08 15:00:11.873095 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:11.873070    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:11.998991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:11.998919    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-bundle\") pod \"79780808-3547-4507-976d-2be324146a55\" (UID: \"79780808-3547-4507-976d-2be324146a55\") "
Sep 08 15:00:11.998991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:11.998968    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-util\") pod \"79780808-3547-4507-976d-2be324146a55\" (UID: \"79780808-3547-4507-976d-2be324146a55\") "
Sep 08 15:00:11.998991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:11.998991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxwlf\" (UniqueName: \"kubernetes.io/projected/79780808-3547-4507-976d-2be324146a55-kube-api-access-xxwlf\") pod \"79780808-3547-4507-976d-2be324146a55\" (UID: \"79780808-3547-4507-976d-2be324146a55\") "
Sep 08 15:00:11.999684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:11.999660    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-bundle" (OuterVolumeSpecName: "bundle") pod "79780808-3547-4507-976d-2be324146a55" (UID: "79780808-3547-4507-976d-2be324146a55"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:12.001014 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.000992    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79780808-3547-4507-976d-2be324146a55-kube-api-access-xxwlf" (OuterVolumeSpecName: "kube-api-access-xxwlf") pod "79780808-3547-4507-976d-2be324146a55" (UID: "79780808-3547-4507-976d-2be324146a55"). InnerVolumeSpecName "kube-api-access-xxwlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:12.003720 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.003700    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-util" (OuterVolumeSpecName: "util") pod "79780808-3547-4507-976d-2be324146a55" (UID: "79780808-3547-4507-976d-2be324146a55"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:12.100507 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.100476    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:00:12.100507 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.100504    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/79780808-3547-4507-976d-2be324146a55-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:00:12.100507 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.100513    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxwlf\" (UniqueName: \"kubernetes.io/projected/79780808-3547-4507-976d-2be324146a55-kube-api-access-xxwlf\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:00:12.755041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.755010    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv"
Sep 08 15:00:12.755041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.755029    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af5bhpv" event={"ID":"79780808-3547-4507-976d-2be324146a55","Type":"ContainerDied","Data":"1116fd203d75c322b29781335b155f87ac58cd58af57725c3fb8d0d39915ec6b"}
Sep 08 15:00:12.755230 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:12.755075    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1116fd203d75c322b29781335b155f87ac58cd58af57725c3fb8d0d39915ec6b"
Sep 08 15:00:21.090858 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.090820    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"]
Sep 08 15:00:21.091213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091125    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79780808-3547-4507-976d-2be324146a55" containerName="util"
Sep 08 15:00:21.091213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091136    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="79780808-3547-4507-976d-2be324146a55" containerName="util"
Sep 08 15:00:21.091213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091145    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79780808-3547-4507-976d-2be324146a55" containerName="pull"
Sep 08 15:00:21.091213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091150    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="79780808-3547-4507-976d-2be324146a55" containerName="pull"
Sep 08 15:00:21.091213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091158    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79780808-3547-4507-976d-2be324146a55" containerName="extract"
Sep 08 15:00:21.091213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091164    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="79780808-3547-4507-976d-2be324146a55" containerName="extract"
Sep 08 15:00:21.091404 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.091230    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="79780808-3547-4507-976d-2be324146a55" containerName="extract"
Sep 08 15:00:21.117744 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.117720    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"]
Sep 08 15:00:21.117872 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.117809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.120067 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.120048    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rwgp9\""
Sep 08 15:00:21.120308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.120293    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:00:21.120843 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.120823    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:00:21.166608 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.166582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrm2\" (UniqueName: \"kubernetes.io/projected/21c2ade1-ab89-4b91-b52f-e0719609ab89-kube-api-access-crrm2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.166698 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.166628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.166698 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.166659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.268003 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.267976    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrm2\" (UniqueName: \"kubernetes.io/projected/21c2ade1-ab89-4b91-b52f-e0719609ab89-kube-api-access-crrm2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.268107 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.268019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.268107 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.268054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.268421 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.268397    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.268421 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.268412    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.275879 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.275858    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrm2\" (UniqueName: \"kubernetes.io/projected/21c2ade1-ab89-4b91-b52f-e0719609ab89-kube-api-access-crrm2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.427080 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.427058    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:21.698038 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.698015    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"]
Sep 08 15:00:21.700071 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:00:21.700035    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c2ade1_ab89_4b91_b52f_e0719609ab89.slice/crio-e360bcf79f090a5999237d842347c9e254b24e29c631473c82d01bdaff8ba4bb WatchSource:0}: Error finding container e360bcf79f090a5999237d842347c9e254b24e29c631473c82d01bdaff8ba4bb: Status 404 returned error can't find the container with id e360bcf79f090a5999237d842347c9e254b24e29c631473c82d01bdaff8ba4bb
Sep 08 15:00:21.796572 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.796538    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q" event={"ID":"21c2ade1-ab89-4b91-b52f-e0719609ab89","Type":"ContainerStarted","Data":"7eb10124c8047c8998773a0976f961a87d13d7d05b65f6367b5f8a60e4a9d59c"}
Sep 08 15:00:21.796684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:21.796601    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q" event={"ID":"21c2ade1-ab89-4b91-b52f-e0719609ab89","Type":"ContainerStarted","Data":"e360bcf79f090a5999237d842347c9e254b24e29c631473c82d01bdaff8ba4bb"}
Sep 08 15:00:22.802703 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:22.802671    2579 generic.go:356] "Generic (PLEG): container finished" podID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerID="7eb10124c8047c8998773a0976f961a87d13d7d05b65f6367b5f8a60e4a9d59c" exitCode=0
Sep 08 15:00:22.803050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:22.802753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q" event={"ID":"21c2ade1-ab89-4b91-b52f-e0719609ab89","Type":"ContainerDied","Data":"7eb10124c8047c8998773a0976f961a87d13d7d05b65f6367b5f8a60e4a9d59c"}
Sep 08 15:00:22.803156 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:22.803140    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:00:23.445221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.445190    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"]
Sep 08 15:00:23.449681 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.449119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.453708 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.453682    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:00:23.453854 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.453733    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:00:23.453854 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.453744    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:00:23.453854 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.453735    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6bscm\""
Sep 08 15:00:23.454124 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.454108    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:00:23.464894 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.464874    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"]
Sep 08 15:00:23.584856 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.584824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce55977-2c4b-4b0b-9baf-85f91217cecd-tmp\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.584990 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.584862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ce55977-2c4b-4b0b-9baf-85f91217cecd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.584990 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.584953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ce55977-2c4b-4b0b-9baf-85f91217cecd-manifests\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.585080 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.585000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ce55977-2c4b-4b0b-9baf-85f91217cecd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.585080 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.585025    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdfb4\" (UniqueName: \"kubernetes.io/projected/6ce55977-2c4b-4b0b-9baf-85f91217cecd-kube-api-access-tdfb4\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.685718 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.685685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ce55977-2c4b-4b0b-9baf-85f91217cecd-manifests\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.685851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.685727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ce55977-2c4b-4b0b-9baf-85f91217cecd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.685851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.685762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdfb4\" (UniqueName: \"kubernetes.io/projected/6ce55977-2c4b-4b0b-9baf-85f91217cecd-kube-api-access-tdfb4\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.685851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.685814    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce55977-2c4b-4b0b-9baf-85f91217cecd-tmp\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.685851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.685847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ce55977-2c4b-4b0b-9baf-85f91217cecd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.686169 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.686138    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6ce55977-2c4b-4b0b-9baf-85f91217cecd-manifests\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.688198 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.688173    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6ce55977-2c4b-4b0b-9baf-85f91217cecd-tmp\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.688294 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.688274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6ce55977-2c4b-4b0b-9baf-85f91217cecd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.688398 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.688379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6ce55977-2c4b-4b0b-9baf-85f91217cecd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.693719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.693694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdfb4\" (UniqueName: \"kubernetes.io/projected/6ce55977-2c4b-4b0b-9baf-85f91217cecd-kube-api-access-tdfb4\") pod \"opendatahub-operator-controller-manager-6b574fc88f-6l54z\" (UID: \"6ce55977-2c4b-4b0b-9baf-85f91217cecd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:23.760350 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:23.760287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:24.036614 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:24.036589    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"]
Sep 08 15:00:24.039043 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:00:24.039019    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ce55977_2c4b_4b0b_9baf_85f91217cecd.slice/crio-6ae25bffc8506dbcde850111e40b6f91904085e79227c1f8f8c250d316e13d3c WatchSource:0}: Error finding container 6ae25bffc8506dbcde850111e40b6f91904085e79227c1f8f8c250d316e13d3c: Status 404 returned error can't find the container with id 6ae25bffc8506dbcde850111e40b6f91904085e79227c1f8f8c250d316e13d3c
Sep 08 15:00:24.814549 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:24.814513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z" event={"ID":"6ce55977-2c4b-4b0b-9baf-85f91217cecd","Type":"ContainerStarted","Data":"6ae25bffc8506dbcde850111e40b6f91904085e79227c1f8f8c250d316e13d3c"}
Sep 08 15:00:25.821710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:25.821616    2579 generic.go:356] "Generic (PLEG): container finished" podID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerID="9beafe999ff5464462c9e9c7634b2c9e058271e484098144a96d912d1594aee7" exitCode=0
Sep 08 15:00:25.821710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:25.821683    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q" event={"ID":"21c2ade1-ab89-4b91-b52f-e0719609ab89","Type":"ContainerDied","Data":"9beafe999ff5464462c9e9c7634b2c9e058271e484098144a96d912d1594aee7"}
Sep 08 15:00:26.829235 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:26.829197    2579 generic.go:356] "Generic (PLEG): container finished" podID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerID="cf531a5ff4e309ca47c3a67daf3dd0b6c596e5b1aabb71bc5f28baa8d9c7566d" exitCode=0
Sep 08 15:00:26.829696 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:26.829290    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q" event={"ID":"21c2ade1-ab89-4b91-b52f-e0719609ab89","Type":"ContainerDied","Data":"cf531a5ff4e309ca47c3a67daf3dd0b6c596e5b1aabb71bc5f28baa8d9c7566d"}
Sep 08 15:00:27.979850 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:27.979826    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:28.124052 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.123991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-bundle\") pod \"21c2ade1-ab89-4b91-b52f-e0719609ab89\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") "
Sep 08 15:00:28.124052 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.124050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crrm2\" (UniqueName: \"kubernetes.io/projected/21c2ade1-ab89-4b91-b52f-e0719609ab89-kube-api-access-crrm2\") pod \"21c2ade1-ab89-4b91-b52f-e0719609ab89\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") "
Sep 08 15:00:28.124239 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.124085    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-util\") pod \"21c2ade1-ab89-4b91-b52f-e0719609ab89\" (UID: \"21c2ade1-ab89-4b91-b52f-e0719609ab89\") "
Sep 08 15:00:28.124974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.124938    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-bundle" (OuterVolumeSpecName: "bundle") pod "21c2ade1-ab89-4b91-b52f-e0719609ab89" (UID: "21c2ade1-ab89-4b91-b52f-e0719609ab89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:28.126108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.126077    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21c2ade1-ab89-4b91-b52f-e0719609ab89-kube-api-access-crrm2" (OuterVolumeSpecName: "kube-api-access-crrm2") pod "21c2ade1-ab89-4b91-b52f-e0719609ab89" (UID: "21c2ade1-ab89-4b91-b52f-e0719609ab89"). InnerVolumeSpecName "kube-api-access-crrm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:00:28.128996 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.128971    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-util" (OuterVolumeSpecName: "util") pod "21c2ade1-ab89-4b91-b52f-e0719609ab89" (UID: "21c2ade1-ab89-4b91-b52f-e0719609ab89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:00:28.224657 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.224626    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:00:28.224657 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.224656    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crrm2\" (UniqueName: \"kubernetes.io/projected/21c2ade1-ab89-4b91-b52f-e0719609ab89-kube-api-access-crrm2\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:00:28.224831 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.224666    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21c2ade1-ab89-4b91-b52f-e0719609ab89-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:00:28.844128 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.844088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q" event={"ID":"21c2ade1-ab89-4b91-b52f-e0719609ab89","Type":"ContainerDied","Data":"e360bcf79f090a5999237d842347c9e254b24e29c631473c82d01bdaff8ba4bb"}
Sep 08 15:00:28.844473 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.844129    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0thx9q"
Sep 08 15:00:28.844473 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:28.844180    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e360bcf79f090a5999237d842347c9e254b24e29c631473c82d01bdaff8ba4bb"
Sep 08 15:00:29.851376 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:29.851337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z" event={"ID":"6ce55977-2c4b-4b0b-9baf-85f91217cecd","Type":"ContainerStarted","Data":"2767e575de756b667b22c0bda7561e424ecabab733bbd3fcb97e8f0545c6cb4c"}
Sep 08 15:00:31.863031 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:31.862997    2579 generic.go:356] "Generic (PLEG): container finished" podID="6ce55977-2c4b-4b0b-9baf-85f91217cecd" containerID="2767e575de756b667b22c0bda7561e424ecabab733bbd3fcb97e8f0545c6cb4c" exitCode=0
Sep 08 15:00:31.863480 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:31.863068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z" event={"ID":"6ce55977-2c4b-4b0b-9baf-85f91217cecd","Type":"ContainerDied","Data":"2767e575de756b667b22c0bda7561e424ecabab733bbd3fcb97e8f0545c6cb4c"}
Sep 08 15:00:32.870663 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:32.870571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z" event={"ID":"6ce55977-2c4b-4b0b-9baf-85f91217cecd","Type":"ContainerStarted","Data":"931cff47c9ade4bfd48dfb2024d92432d2cdb9609f637c9f6346defd67685fb2"}
Sep 08 15:00:32.871116 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:32.870838    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:32.894362 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:32.894313    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z" podStartSLOduration=2.457723439 podStartE2EDuration="9.894299684s" totalImagesPullingTime="6.345201675s" totalInitContainerRuntime="1.09137457s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:32.892156715 +0000 UTC m=+324.039177661" watchObservedRunningTime="2026-09-08 15:00:32.894299684 +0000 UTC m=+324.041320591"
Sep 08 15:00:43.877712 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:43.877680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b574fc88f-6l54z"
Sep 08 15:00:46.095631 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095552    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"]
Sep 08 15:00:46.095973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095911    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="util"
Sep 08 15:00:46.095973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095925    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="util"
Sep 08 15:00:46.095973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095937    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="pull"
Sep 08 15:00:46.095973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095942    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="pull"
Sep 08 15:00:46.095973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095959    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="extract"
Sep 08 15:00:46.095973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.095964    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="extract"
Sep 08 15:00:46.096160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.096023    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="21c2ade1-ab89-4b91-b52f-e0719609ab89" containerName="extract"
Sep 08 15:00:46.103555 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.103529    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.107122 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.107098    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 15:00:46.107223 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.107106    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:00:46.107223 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.107137    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:00:46.107805 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.107786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 15:00:46.107964 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.107837    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-grkw6\""
Sep 08 15:00:46.115793 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.115773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"]
Sep 08 15:00:46.272545 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.272510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7204b55-53c3-4863-b768-ab62af7ffb2b-tmp\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.272545 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.272568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv6jt\" (UniqueName: \"kubernetes.io/projected/e7204b55-53c3-4863-b768-ab62af7ffb2b-kube-api-access-dv6jt\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.272775 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.272629    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7204b55-53c3-4863-b768-ab62af7ffb2b-tls-certs\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.373020 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.372963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv6jt\" (UniqueName: \"kubernetes.io/projected/e7204b55-53c3-4863-b768-ab62af7ffb2b-kube-api-access-dv6jt\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.373020 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.372994    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7204b55-53c3-4863-b768-ab62af7ffb2b-tls-certs\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.373164 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.373076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7204b55-53c3-4863-b768-ab62af7ffb2b-tmp\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.375282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.375252    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7204b55-53c3-4863-b768-ab62af7ffb2b-tmp\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.375539 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.375521    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7204b55-53c3-4863-b768-ab62af7ffb2b-tls-certs\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.383465 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.383422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv6jt\" (UniqueName: \"kubernetes.io/projected/e7204b55-53c3-4863-b768-ab62af7ffb2b-kube-api-access-dv6jt\") pod \"kube-auth-proxy-5ff8c49fcd-48fc6\" (UID: \"e7204b55-53c3-4863-b768-ab62af7ffb2b\") " pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.413357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.413326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"
Sep 08 15:00:46.683779 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.683751    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6"]
Sep 08 15:00:46.686881 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:00:46.686856    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7204b55_53c3_4863_b768_ab62af7ffb2b.slice/crio-3068e9403b4f89f1538c5f6542f4caab880ee14302758c45b497384838b21bd4 WatchSource:0}: Error finding container 3068e9403b4f89f1538c5f6542f4caab880ee14302758c45b497384838b21bd4: Status 404 returned error can't find the container with id 3068e9403b4f89f1538c5f6542f4caab880ee14302758c45b497384838b21bd4
Sep 08 15:00:46.937832 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:46.937759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6" event={"ID":"e7204b55-53c3-4863-b768-ab62af7ffb2b","Type":"ContainerStarted","Data":"3068e9403b4f89f1538c5f6542f4caab880ee14302758c45b497384838b21bd4"}
Sep 08 15:00:47.616812 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.616774    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"]
Sep 08 15:00:47.620419 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.620396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.623734 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.623545    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 15:00:47.623869 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.623768    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 15:00:47.624006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.623980    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:00:47.624127 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.624064    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7npkb\""
Sep 08 15:00:47.624227 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.624206    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 15:00:47.635939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.635912    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"]
Sep 08 15:00:47.786782 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.786739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990fc1d-1197-4ff7-a921-73501c96c40c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.786955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.786787    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.786955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.786859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.786955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.786882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.786955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.786901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.786955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.786924    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssj4\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-kube-api-access-jssj4\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.787224 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.787002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.887632 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.887523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.887632 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.887604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.887859 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.887634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jssj4\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-kube-api-access-jssj4\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.888357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.888007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.888357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.888112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990fc1d-1197-4ff7-a921-73501c96c40c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.888357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.888154    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.888357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.888330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.888926 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.888899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.890687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.890659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.890951 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.890929    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990fc1d-1197-4ff7-a921-73501c96c40c-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.892126 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.892090    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.893318 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.893294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.896925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.896899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.897145 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.897116    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssj4\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-kube-api-access-jssj4\") pod \"istiod-openshift-gateway-7b7995d5cd-ldvsh\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:47.934234 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:47.934204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:48.241382 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:48.241349    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"]
Sep 08 15:00:48.242808 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:00:48.242770    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2990fc1d_1197_4ff7_a921_73501c96c40c.slice/crio-165b46e2839bad625cf34819e184dcc01a7a1d18f4586a8751947912033b16ce WatchSource:0}: Error finding container 165b46e2839bad625cf34819e184dcc01a7a1d18f4586a8751947912033b16ce: Status 404 returned error can't find the container with id 165b46e2839bad625cf34819e184dcc01a7a1d18f4586a8751947912033b16ce
Sep 08 15:00:48.953325 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:48.953284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" event={"ID":"2990fc1d-1197-4ff7-a921-73501c96c40c","Type":"ContainerStarted","Data":"165b46e2839bad625cf34819e184dcc01a7a1d18f4586a8751947912033b16ce"}
Sep 08 15:00:49.961726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:49.961640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6" event={"ID":"e7204b55-53c3-4863-b768-ab62af7ffb2b","Type":"ContainerStarted","Data":"10c8e1e4bac37af6294ad3b108621f42351d5df2493243e04f506c1ca1872d41"}
Sep 08 15:00:49.979511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:49.979429    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5ff8c49fcd-48fc6" podStartSLOduration=0.98499965 podStartE2EDuration="3.979409607s" totalImagesPullingTime="2.994409957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:49.977244002 +0000 UTC m=+341.124264908" watchObservedRunningTime="2026-09-08 15:00:49.979409607 +0000 UTC m=+341.126430517"
Sep 08 15:00:51.487688 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:51.487647    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:00:51.487992 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:51.487720    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:00:51.974458 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:51.974418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" event={"ID":"2990fc1d-1197-4ff7-a921-73501c96c40c","Type":"ContainerStarted","Data":"a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd"}
Sep 08 15:00:51.974612 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:51.974546    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:00:51.998997 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:51.998951    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" podStartSLOduration=1.7573295199999999 podStartE2EDuration="4.998938322s" totalImagesPullingTime="3.241608802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:00:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:00:51.997013235 +0000 UTC m=+343.144034142" watchObservedRunningTime="2026-09-08 15:00:51.998938322 +0000 UTC m=+343.145959228"
Sep 08 15:00:52.981058 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:52.981015    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-ldvsh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:00:52.981395 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:52.981073    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" podUID="2990fc1d-1197-4ff7-a921-73501c96c40c" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:00:55.980338 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:00:55.980300    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:01:04.675645 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.675571    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"]
Sep 08 15:01:04.682173 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.682156    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.706475 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.706430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"]
Sep 08 15:01:04.729229 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.729319 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r297v\" (UniqueName: \"kubernetes.io/projected/07aee408-9d9e-4798-bfe7-da9c0e58064f-kube-api-access-r297v\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.729319 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.729394 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aee408-9d9e-4798-bfe7-da9c0e58064f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.729394 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729346    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.729394 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729381    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.729519 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.729400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829728 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aee408-9d9e-4798-bfe7-da9c0e58064f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r297v\" (UniqueName: \"kubernetes.io/projected/07aee408-9d9e-4798-bfe7-da9c0e58064f-kube-api-access-r297v\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.829877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.829869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.830622 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.830596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.832284 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.832258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.832284 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.832269    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.832468 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.832384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/07aee408-9d9e-4798-bfe7-da9c0e58064f-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.832519 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.832469    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.844736 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.844717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r297v\" (UniqueName: \"kubernetes.io/projected/07aee408-9d9e-4798-bfe7-da9c0e58064f-kube-api-access-r297v\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.844886 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.844865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07aee408-9d9e-4798-bfe7-da9c0e58064f-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-rxhfh\" (UID: \"07aee408-9d9e-4798-bfe7-da9c0e58064f\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:04.991630 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:04.991565    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:05.280841 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:05.280807    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"]
Sep 08 15:01:05.282278 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:01:05.282254    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07aee408_9d9e_4798_bfe7_da9c0e58064f.slice/crio-74eebe9e1f3f351aa81ed3a23e3be4a91d9f0209fc3c2f35d0327b74cc096adc WatchSource:0}: Error finding container 74eebe9e1f3f351aa81ed3a23e3be4a91d9f0209fc3c2f35d0327b74cc096adc: Status 404 returned error can't find the container with id 74eebe9e1f3f351aa81ed3a23e3be4a91d9f0209fc3c2f35d0327b74cc096adc
Sep 08 15:01:05.285278 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:05.285245    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:01:05.285375 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:05.285324    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:01:06.043767 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:06.043729    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh" event={"ID":"07aee408-9d9e-4798-bfe7-da9c0e58064f","Type":"ContainerStarted","Data":"494779f2df4910d11f4903a1889104b68c611cbce105b778bcce28aea05e34fe"}
Sep 08 15:01:06.044128 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:06.043781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh" event={"ID":"07aee408-9d9e-4798-bfe7-da9c0e58064f","Type":"ContainerStarted","Data":"74eebe9e1f3f351aa81ed3a23e3be4a91d9f0209fc3c2f35d0327b74cc096adc"}
Sep 08 15:01:06.044128 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:06.043925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:06.045747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:06.045724    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-rxhfh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:01:06.045860 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:06.045767    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh" podUID="07aee408-9d9e-4798-bfe7-da9c0e58064f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:01:06.073917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:06.073864    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh" podStartSLOduration=2.07384579 podStartE2EDuration="2.07384579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:01:06.070725739 +0000 UTC m=+357.217746645" watchObservedRunningTime="2026-09-08 15:01:06.07384579 +0000 UTC m=+357.220866699"
Sep 08 15:01:07.049834 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:07.049794    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-rxhfh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:01:07.050188 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:07.049855    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh" podUID="07aee408-9d9e-4798-bfe7-da9c0e58064f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:01:10.050346 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.050311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-rxhfh"
Sep 08 15:01:10.108318 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.108278    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"]
Sep 08 15:01:10.108516 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.108493    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" podUID="2990fc1d-1197-4ff7-a921-73501c96c40c" containerName="discovery" containerID="cri-o://a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd" gracePeriod=30
Sep 08 15:01:10.356075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.356052    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:01:10.472859 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.472829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-ca-configmap\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.472859 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.472861    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-token\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.473034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.472878    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-cacerts\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.473034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.472925    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990fc1d-1197-4ff7-a921-73501c96c40c-local-certs\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.473034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.472948    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-kubeconfig\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.473034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.472993    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-dns-cert\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.473250 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.473057    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jssj4\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-kube-api-access-jssj4\") pod \"2990fc1d-1197-4ff7-a921-73501c96c40c\" (UID: \"2990fc1d-1197-4ff7-a921-73501c96c40c\") "
Sep 08 15:01:10.473315 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.473243    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:01:10.473395 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.473376    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-ca-configmap\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:10.475210 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.475178    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:01:10.475335 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.475227    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-kube-api-access-jssj4" (OuterVolumeSpecName: "kube-api-access-jssj4") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "kube-api-access-jssj4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:01:10.475416 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.475397    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-token" (OuterVolumeSpecName: "istio-token") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:01:10.475532 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.475411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:01:10.475532 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.475517    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2990fc1d-1197-4ff7-a921-73501c96c40c-local-certs" (OuterVolumeSpecName: "local-certs") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:01:10.475621 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.475520    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-cacerts" (OuterVolumeSpecName: "cacerts") pod "2990fc1d-1197-4ff7-a921-73501c96c40c" (UID: "2990fc1d-1197-4ff7-a921-73501c96c40c"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:01:10.573972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.573946    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-csr-dns-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:10.573972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.573968    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jssj4\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-kube-api-access-jssj4\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:10.574110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.573979    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:10.574110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.573988    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-cacerts\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:10.574110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.573995    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/2990fc1d-1197-4ff7-a921-73501c96c40c-local-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:10.574110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:10.574003    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2990fc1d-1197-4ff7-a921-73501c96c40c-istio-kubeconfig\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:01:11.070189 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.070154    2579 generic.go:356] "Generic (PLEG): container finished" podID="2990fc1d-1197-4ff7-a921-73501c96c40c" containerID="a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd" exitCode=0
Sep 08 15:01:11.070578 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.070195    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"
Sep 08 15:01:11.070578 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.070226    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" event={"ID":"2990fc1d-1197-4ff7-a921-73501c96c40c","Type":"ContainerDied","Data":"a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd"}
Sep 08 15:01:11.070578 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.070285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh" event={"ID":"2990fc1d-1197-4ff7-a921-73501c96c40c","Type":"ContainerDied","Data":"165b46e2839bad625cf34819e184dcc01a7a1d18f4586a8751947912033b16ce"}
Sep 08 15:01:11.070578 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.070314    2579 scope.go:117] "RemoveContainer" containerID="a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd"
Sep 08 15:01:11.079176 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.079161    2579 scope.go:117] "RemoveContainer" containerID="a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd"
Sep 08 15:01:11.079405 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:01:11.079388    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd\": container with ID starting with a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd not found: ID does not exist" containerID="a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd"
Sep 08 15:01:11.079495 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.079414    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd"} err="failed to get container status \"a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd\": rpc error: code = NotFound desc = could not find container \"a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd\": container with ID starting with a733eb31309fe9ecd91031582bb431a582b92260929cecc737e253d7858995fd not found: ID does not exist"
Sep 08 15:01:11.095721 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.095697    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"]
Sep 08 15:01:11.104998 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.104980    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-ldvsh"]
Sep 08 15:01:11.388377 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:11.388306    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2990fc1d-1197-4ff7-a921-73501c96c40c" path="/var/lib/kubelet/pods/2990fc1d-1197-4ff7-a921-73501c96c40c/volumes"
Sep 08 15:01:40.766754 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.766719    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8547cb958b-s9mw6"]
Sep 08 15:01:40.767236 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.767113    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2990fc1d-1197-4ff7-a921-73501c96c40c" containerName="discovery"
Sep 08 15:01:40.767236 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.767126    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2990fc1d-1197-4ff7-a921-73501c96c40c" containerName="discovery"
Sep 08 15:01:40.767236 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.767199    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2990fc1d-1197-4ff7-a921-73501c96c40c" containerName="discovery"
Sep 08 15:01:40.769830 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.769808    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.780580 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.780559    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8547cb958b-s9mw6"]
Sep 08 15:01:40.896704 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-console-config\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.896851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896708    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-trusted-ca-bundle\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.896851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896739    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01274068-2ccf-4dac-8527-be28f9996f8e-console-serving-cert\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.896851 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01274068-2ccf-4dac-8527-be28f9996f8e-console-oauth-config\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.896991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-service-ca\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.896991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-oauth-serving-cert\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.896991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.896902    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td8v8\" (UniqueName: \"kubernetes.io/projected/01274068-2ccf-4dac-8527-be28f9996f8e-kube-api-access-td8v8\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01274068-2ccf-4dac-8527-be28f9996f8e-console-oauth-config\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-service-ca\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998359 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998178    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-oauth-serving-cert\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998359 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td8v8\" (UniqueName: \"kubernetes.io/projected/01274068-2ccf-4dac-8527-be28f9996f8e-kube-api-access-td8v8\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998483 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998383    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-console-config\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998483 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-trusted-ca-bundle\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.998483 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.998465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01274068-2ccf-4dac-8527-be28f9996f8e-console-serving-cert\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.999538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.999130    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-service-ca\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.999538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.999285    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-oauth-serving-cert\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.999538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.999487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-trusted-ca-bundle\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:40.999924 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:40.999899    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01274068-2ccf-4dac-8527-be28f9996f8e-console-config\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:41.000988 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:41.000959    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01274068-2ccf-4dac-8527-be28f9996f8e-console-oauth-config\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:41.001203 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:41.001184    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01274068-2ccf-4dac-8527-be28f9996f8e-console-serving-cert\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:41.007035 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:41.007014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td8v8\" (UniqueName: \"kubernetes.io/projected/01274068-2ccf-4dac-8527-be28f9996f8e-kube-api-access-td8v8\") pod \"console-8547cb958b-s9mw6\" (UID: \"01274068-2ccf-4dac-8527-be28f9996f8e\") " pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:41.080232 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:41.080175    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:41.357008 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:41.356965    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8547cb958b-s9mw6"]
Sep 08 15:01:41.359605 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:01:41.359579    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01274068_2ccf_4dac_8527_be28f9996f8e.slice/crio-2ddeee76c9fcc645508abe33f3297b3eb507888f0074ef541a41af0c681a0913 WatchSource:0}: Error finding container 2ddeee76c9fcc645508abe33f3297b3eb507888f0074ef541a41af0c681a0913: Status 404 returned error can't find the container with id 2ddeee76c9fcc645508abe33f3297b3eb507888f0074ef541a41af0c681a0913
Sep 08 15:01:42.246870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:42.246835    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8547cb958b-s9mw6" event={"ID":"01274068-2ccf-4dac-8527-be28f9996f8e","Type":"ContainerStarted","Data":"34a34e625fed85168374a9b3575d025feb057224bcfb8ffa73d2a77379b33cd5"}
Sep 08 15:01:42.247328 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:42.246886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8547cb958b-s9mw6" event={"ID":"01274068-2ccf-4dac-8527-be28f9996f8e","Type":"ContainerStarted","Data":"2ddeee76c9fcc645508abe33f3297b3eb507888f0074ef541a41af0c681a0913"}
Sep 08 15:01:42.278038 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:42.277980    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8547cb958b-s9mw6" podStartSLOduration=2.277954791 podStartE2EDuration="2.277954791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:01:42.274886692 +0000 UTC m=+393.421907580" watchObservedRunningTime="2026-09-08 15:01:42.277954791 +0000 UTC m=+393.424975699"
Sep 08 15:01:51.080677 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:51.080643    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:51.081041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:51.080704    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:51.085172 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:51.085152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:51.296846 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:51.296821    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8547cb958b-s9mw6"
Sep 08 15:01:51.343311 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:01:51.343246    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bf44db7c8-lkr2t"]
Sep 08 15:02:01.644083 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.644049    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"]
Sep 08 15:02:01.647042 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.647025    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.649223 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.649197    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:02:01.649363 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.649235    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:02:01.649872 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.649856    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rwgp9\""
Sep 08 15:02:01.656003 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.655984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"]
Sep 08 15:02:01.737842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.737809    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"]
Sep 08 15:02:01.740369 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.740352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.748959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.748931    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"]
Sep 08 15:02:01.759006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.758978    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.759129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.759086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vjfk\" (UniqueName: \"kubernetes.io/projected/922d292d-1368-4520-b03a-3c8e5c9593a4-kube-api-access-4vjfk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.759170 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.759130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.836114 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.836084    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"]
Sep 08 15:02:01.838605 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.838590    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:01.848304 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.848283    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"]
Sep 08 15:02:01.860467 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gzst\" (UniqueName: \"kubernetes.io/projected/fbc62068-696d-4163-ac1a-d4584e18e7a6-kube-api-access-7gzst\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.860567 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vjfk\" (UniqueName: \"kubernetes.io/projected/922d292d-1368-4520-b03a-3c8e5c9593a4-kube-api-access-4vjfk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.860567 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860539    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.860700 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.860700 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860639    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.860799 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.860893 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.860875    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.861027 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.861009    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.868358 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.868339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vjfk\" (UniqueName: \"kubernetes.io/projected/922d292d-1368-4520-b03a-3c8e5c9593a4-kube-api-access-4vjfk\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.934761 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.934704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"]
Sep 08 15:02:01.937273 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.937258    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:01.946009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.945985    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"]
Sep 08 15:02:01.957368 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.957344    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:02:01.961488 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/f0cfb3f7-a408-43fb-9838-044a0fe4982d-kube-api-access-7sklv\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:01.961611 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.961611 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:01.961733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961674    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:01.961788 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gzst\" (UniqueName: \"kubernetes.io/projected/fbc62068-696d-4163-ac1a-d4584e18e7a6-kube-api-access-7gzst\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.961788 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961760    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.961891 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.961873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.962073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.962050    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:01.970889 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:01.970869    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gzst\" (UniqueName: \"kubernetes.io/projected/fbc62068-696d-4163-ac1a-d4584e18e7a6-kube-api-access-7gzst\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:02.049763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.049736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:02.062557 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.062530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/f0cfb3f7-a408-43fb-9838-044a0fe4982d-kube-api-access-7sklv\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.062663 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.062573    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.062733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.062693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.062788 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.062769    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqc64\" (UniqueName: \"kubernetes.io/projected/b3875fae-6936-4800-a32d-f4bd88cc2bbe-kube-api-access-zqc64\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.062843 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.062820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.062896 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.062851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.063152 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.063133    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.063256 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.063234    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.078673 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.078650    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/f0cfb3f7-a408-43fb-9838-044a0fe4982d-kube-api-access-7sklv\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.147719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.147692    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:02.163522 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.163498    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.163619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.163572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqc64\" (UniqueName: \"kubernetes.io/projected/b3875fae-6936-4800-a32d-f4bd88cc2bbe-kube-api-access-zqc64\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.163665 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.163624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.163891 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.163874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.164006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.163983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.171849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.171823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqc64\" (UniqueName: \"kubernetes.io/projected/b3875fae-6936-4800-a32d-f4bd88cc2bbe-kube-api-access-zqc64\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.228221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.228192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"]
Sep 08 15:02:02.230290 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:02:02.230265    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922d292d_1368_4520_b03a_3c8e5c9593a4.slice/crio-61408376ec481765213bfe0a2aaea49e1b7babdebf48e6e4984dd61db5fbcbea WatchSource:0}: Error finding container 61408376ec481765213bfe0a2aaea49e1b7babdebf48e6e4984dd61db5fbcbea: Status 404 returned error can't find the container with id 61408376ec481765213bfe0a2aaea49e1b7babdebf48e6e4984dd61db5fbcbea
Sep 08 15:02:02.246813 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.246797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:02.324558 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.324530    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"]
Sep 08 15:02:02.327105 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:02:02.327077    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc62068_696d_4163_ac1a_d4584e18e7a6.slice/crio-4900e99d7d568885d4cc304a33c5faabc46751c45ce64412ee23df04ca8d72b7 WatchSource:0}: Error finding container 4900e99d7d568885d4cc304a33c5faabc46751c45ce64412ee23df04ca8d72b7: Status 404 returned error can't find the container with id 4900e99d7d568885d4cc304a33c5faabc46751c45ce64412ee23df04ca8d72b7
Sep 08 15:02:02.350866 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.350842    2579 generic.go:356] "Generic (PLEG): container finished" podID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerID="f6c0ca0eb5d6d243c59249e1a157995d4408d0d801513311fded55b5470a7a2e" exitCode=0
Sep 08 15:02:02.350974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.350925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs" event={"ID":"922d292d-1368-4520-b03a-3c8e5c9593a4","Type":"ContainerDied","Data":"f6c0ca0eb5d6d243c59249e1a157995d4408d0d801513311fded55b5470a7a2e"}
Sep 08 15:02:02.350974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.350973    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs" event={"ID":"922d292d-1368-4520-b03a-3c8e5c9593a4","Type":"ContainerStarted","Data":"61408376ec481765213bfe0a2aaea49e1b7babdebf48e6e4984dd61db5fbcbea"}
Sep 08 15:02:02.352282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.352261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w" event={"ID":"fbc62068-696d-4163-ac1a-d4584e18e7a6","Type":"ContainerStarted","Data":"4900e99d7d568885d4cc304a33c5faabc46751c45ce64412ee23df04ca8d72b7"}
Sep 08 15:02:02.418330 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.418308    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"]
Sep 08 15:02:02.420847 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:02:02.420824    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0cfb3f7_a408_43fb_9838_044a0fe4982d.slice/crio-147b55bb80d33dfe192655306705a20314422459a4c7cdf127a6249f892f635b WatchSource:0}: Error finding container 147b55bb80d33dfe192655306705a20314422459a4c7cdf127a6249f892f635b: Status 404 returned error can't find the container with id 147b55bb80d33dfe192655306705a20314422459a4c7cdf127a6249f892f635b
Sep 08 15:02:02.533362 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:02.533337    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"]
Sep 08 15:02:02.535528 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:02:02.535501    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3875fae_6936_4800_a32d_f4bd88cc2bbe.slice/crio-9becfaf5b4100994a828bb51f4e6686c978f3e9782cf3ea5d057fc4dee3383e3 WatchSource:0}: Error finding container 9becfaf5b4100994a828bb51f4e6686c978f3e9782cf3ea5d057fc4dee3383e3: Status 404 returned error can't find the container with id 9becfaf5b4100994a828bb51f4e6686c978f3e9782cf3ea5d057fc4dee3383e3
Sep 08 15:02:03.359184 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.359154    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerID="edc71b2fab27dba97bc8965f95821ecf10dc8ef7b33c0aae9d9c4576ccc23d67" exitCode=0
Sep 08 15:02:03.359584 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.359248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w" event={"ID":"fbc62068-696d-4163-ac1a-d4584e18e7a6","Type":"ContainerDied","Data":"edc71b2fab27dba97bc8965f95821ecf10dc8ef7b33c0aae9d9c4576ccc23d67"}
Sep 08 15:02:03.360720 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.360689    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerID="836a8d3b7fc0b30cdd76a9f03f4cc11efbb2491e55ef67d93d3cc334004a3241" exitCode=0
Sep 08 15:02:03.360777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.360733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj" event={"ID":"b3875fae-6936-4800-a32d-f4bd88cc2bbe","Type":"ContainerDied","Data":"836a8d3b7fc0b30cdd76a9f03f4cc11efbb2491e55ef67d93d3cc334004a3241"}
Sep 08 15:02:03.360840 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.360783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj" event={"ID":"b3875fae-6936-4800-a32d-f4bd88cc2bbe","Type":"ContainerStarted","Data":"9becfaf5b4100994a828bb51f4e6686c978f3e9782cf3ea5d057fc4dee3383e3"}
Sep 08 15:02:03.369386 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.369359    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerID="56464fc8735ebf5c2b871652ccd4cf0fb971cb89cef8490943653bfde8891820" exitCode=0
Sep 08 15:02:03.369506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.369431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx" event={"ID":"f0cfb3f7-a408-43fb-9838-044a0fe4982d","Type":"ContainerDied","Data":"56464fc8735ebf5c2b871652ccd4cf0fb971cb89cef8490943653bfde8891820"}
Sep 08 15:02:03.369579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:03.369516    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx" event={"ID":"f0cfb3f7-a408-43fb-9838-044a0fe4982d","Type":"ContainerStarted","Data":"147b55bb80d33dfe192655306705a20314422459a4c7cdf127a6249f892f635b"}
Sep 08 15:02:04.376993 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:04.376961    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerID="1b64b95d8250b5c53173446fbfb2c75dba8db5a8a79676f0f4cc3cee990dfffb" exitCode=0
Sep 08 15:02:04.377330 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:04.377040    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj" event={"ID":"b3875fae-6936-4800-a32d-f4bd88cc2bbe","Type":"ContainerDied","Data":"1b64b95d8250b5c53173446fbfb2c75dba8db5a8a79676f0f4cc3cee990dfffb"}
Sep 08 15:02:04.379111 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:04.379087    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerID="98791f7064a1e760c872a5a3ea266f9adf572f9c90a2dc60f062601601207c3b" exitCode=0
Sep 08 15:02:04.379195 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:04.379157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w" event={"ID":"fbc62068-696d-4163-ac1a-d4584e18e7a6","Type":"ContainerDied","Data":"98791f7064a1e760c872a5a3ea266f9adf572f9c90a2dc60f062601601207c3b"}
Sep 08 15:02:05.387369 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:05.387290    2579 generic.go:356] "Generic (PLEG): container finished" podID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerID="c7104b70ecb59a717c3e183c6052c940e3af77daa7d33b608127d274dc32bed8" exitCode=0
Sep 08 15:02:05.388101 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:05.388070    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj" event={"ID":"b3875fae-6936-4800-a32d-f4bd88cc2bbe","Type":"ContainerDied","Data":"c7104b70ecb59a717c3e183c6052c940e3af77daa7d33b608127d274dc32bed8"}
Sep 08 15:02:05.389163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:05.389140    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerID="6bea79058c25d76bd638040dd37ae356efee6e63630e6d418b65d811a7d6cd31" exitCode=0
Sep 08 15:02:05.389276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:05.389223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx" event={"ID":"f0cfb3f7-a408-43fb-9838-044a0fe4982d","Type":"ContainerDied","Data":"6bea79058c25d76bd638040dd37ae356efee6e63630e6d418b65d811a7d6cd31"}
Sep 08 15:02:05.391330 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:05.391309    2579 generic.go:356] "Generic (PLEG): container finished" podID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerID="0498028e78948d8f284dee0a310e9d8774c910d81fb65db2fe0f6c346d6b954f" exitCode=0
Sep 08 15:02:05.391412 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:05.391396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w" event={"ID":"fbc62068-696d-4163-ac1a-d4584e18e7a6","Type":"ContainerDied","Data":"0498028e78948d8f284dee0a310e9d8774c910d81fb65db2fe0f6c346d6b954f"}
Sep 08 15:02:06.398853 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.398818    2579 generic.go:356] "Generic (PLEG): container finished" podID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerID="00f6b7e1a908149c3e81e34d46eed3baf105c67444048e9d20040941239e7b13" exitCode=0
Sep 08 15:02:06.399304 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.398906    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx" event={"ID":"f0cfb3f7-a408-43fb-9838-044a0fe4982d","Type":"ContainerDied","Data":"00f6b7e1a908149c3e81e34d46eed3baf105c67444048e9d20040941239e7b13"}
Sep 08 15:02:06.552623 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.552604    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:06.555754 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.555727    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:06.696916 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.696842    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gzst\" (UniqueName: \"kubernetes.io/projected/fbc62068-696d-4163-ac1a-d4584e18e7a6-kube-api-access-7gzst\") pod \"fbc62068-696d-4163-ac1a-d4584e18e7a6\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") "
Sep 08 15:02:06.696916 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.696906    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqc64\" (UniqueName: \"kubernetes.io/projected/b3875fae-6936-4800-a32d-f4bd88cc2bbe-kube-api-access-zqc64\") pod \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") "
Sep 08 15:02:06.697129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.696947    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-util\") pod \"fbc62068-696d-4163-ac1a-d4584e18e7a6\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") "
Sep 08 15:02:06.697129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.696973    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-bundle\") pod \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") "
Sep 08 15:02:06.697129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.696999    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-util\") pod \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\" (UID: \"b3875fae-6936-4800-a32d-f4bd88cc2bbe\") "
Sep 08 15:02:06.697129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.697056    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-bundle\") pod \"fbc62068-696d-4163-ac1a-d4584e18e7a6\" (UID: \"fbc62068-696d-4163-ac1a-d4584e18e7a6\") "
Sep 08 15:02:06.697636 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.697605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-bundle" (OuterVolumeSpecName: "bundle") pod "b3875fae-6936-4800-a32d-f4bd88cc2bbe" (UID: "b3875fae-6936-4800-a32d-f4bd88cc2bbe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:06.697759 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.697607    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-bundle" (OuterVolumeSpecName: "bundle") pod "fbc62068-696d-4163-ac1a-d4584e18e7a6" (UID: "fbc62068-696d-4163-ac1a-d4584e18e7a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:06.699034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.699005    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc62068-696d-4163-ac1a-d4584e18e7a6-kube-api-access-7gzst" (OuterVolumeSpecName: "kube-api-access-7gzst") pod "fbc62068-696d-4163-ac1a-d4584e18e7a6" (UID: "fbc62068-696d-4163-ac1a-d4584e18e7a6"). InnerVolumeSpecName "kube-api-access-7gzst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:06.699034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.699001    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3875fae-6936-4800-a32d-f4bd88cc2bbe-kube-api-access-zqc64" (OuterVolumeSpecName: "kube-api-access-zqc64") pod "b3875fae-6936-4800-a32d-f4bd88cc2bbe" (UID: "b3875fae-6936-4800-a32d-f4bd88cc2bbe"). InnerVolumeSpecName "kube-api-access-zqc64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:06.706091 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.706064    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-util" (OuterVolumeSpecName: "util") pod "fbc62068-696d-4163-ac1a-d4584e18e7a6" (UID: "fbc62068-696d-4163-ac1a-d4584e18e7a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:06.706271 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.706255    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-util" (OuterVolumeSpecName: "util") pod "b3875fae-6936-4800-a32d-f4bd88cc2bbe" (UID: "b3875fae-6936-4800-a32d-f4bd88cc2bbe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:06.797972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.797951    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gzst\" (UniqueName: \"kubernetes.io/projected/fbc62068-696d-4163-ac1a-d4584e18e7a6-kube-api-access-7gzst\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.797972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.797971    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqc64\" (UniqueName: \"kubernetes.io/projected/b3875fae-6936-4800-a32d-f4bd88cc2bbe-kube-api-access-zqc64\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.798075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.797980    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.798075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.797991    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.798075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.797998    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b3875fae-6936-4800-a32d-f4bd88cc2bbe-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:06.798075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:06.798006    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc62068-696d-4163-ac1a-d4584e18e7a6-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:07.405958 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.405937    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w"
Sep 08 15:02:07.406276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.405975    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05h69w" event={"ID":"fbc62068-696d-4163-ac1a-d4584e18e7a6","Type":"ContainerDied","Data":"4900e99d7d568885d4cc304a33c5faabc46751c45ce64412ee23df04ca8d72b7"}
Sep 08 15:02:07.406276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.406041    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4900e99d7d568885d4cc304a33c5faabc46751c45ce64412ee23df04ca8d72b7"
Sep 08 15:02:07.408283 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.408261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj"
Sep 08 15:02:07.408283 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.408272    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cdxjmj" event={"ID":"b3875fae-6936-4800-a32d-f4bd88cc2bbe","Type":"ContainerDied","Data":"9becfaf5b4100994a828bb51f4e6686c978f3e9782cf3ea5d057fc4dee3383e3"}
Sep 08 15:02:07.408414 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.408302    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9becfaf5b4100994a828bb51f4e6686c978f3e9782cf3ea5d057fc4dee3383e3"
Sep 08 15:02:07.523482 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.523459    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:07.705685 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.705612    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-bundle\") pod \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") "
Sep 08 15:02:07.705685 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.705685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/f0cfb3f7-a408-43fb-9838-044a0fe4982d-kube-api-access-7sklv\") pod \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") "
Sep 08 15:02:07.705892 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.705716    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-util\") pod \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\" (UID: \"f0cfb3f7-a408-43fb-9838-044a0fe4982d\") "
Sep 08 15:02:07.706288 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.706264    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-bundle" (OuterVolumeSpecName: "bundle") pod "f0cfb3f7-a408-43fb-9838-044a0fe4982d" (UID: "f0cfb3f7-a408-43fb-9838-044a0fe4982d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:07.707691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.707668    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0cfb3f7-a408-43fb-9838-044a0fe4982d-kube-api-access-7sklv" (OuterVolumeSpecName: "kube-api-access-7sklv") pod "f0cfb3f7-a408-43fb-9838-044a0fe4982d" (UID: "f0cfb3f7-a408-43fb-9838-044a0fe4982d"). InnerVolumeSpecName "kube-api-access-7sklv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:07.711168 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.711129    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-util" (OuterVolumeSpecName: "util") pod "f0cfb3f7-a408-43fb-9838-044a0fe4982d" (UID: "f0cfb3f7-a408-43fb-9838-044a0fe4982d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:02:07.806666 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.806645    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:07.806666 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.806666    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7sklv\" (UniqueName: \"kubernetes.io/projected/f0cfb3f7-a408-43fb-9838-044a0fe4982d-kube-api-access-7sklv\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:07.806777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:07.806676    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0cfb3f7-a408-43fb-9838-044a0fe4982d-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:08.416308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:08.416271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx" event={"ID":"f0cfb3f7-a408-43fb-9838-044a0fe4982d","Type":"ContainerDied","Data":"147b55bb80d33dfe192655306705a20314422459a4c7cdf127a6249f892f635b"}
Sep 08 15:02:08.416790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:08.416318    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="147b55bb80d33dfe192655306705a20314422459a4c7cdf127a6249f892f635b"
Sep 08 15:02:08.416790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:08.416320    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053v6kqx"
Sep 08 15:02:16.364219 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.364175    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bf44db7c8-lkr2t" podUID="420f0acd-e908-4fcb-9e3e-585138fcb21a" containerName="console" containerID="cri-o://92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1" gracePeriod=15
Sep 08 15:02:16.600063 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.600041    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 15:02:16.663215 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-oauth-config\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663222    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-serving-cert\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663241    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlhbj\" (UniqueName: \"kubernetes.io/projected/420f0acd-e908-4fcb-9e3e-585138fcb21a-kube-api-access-tlhbj\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663288    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-oauth-serving-cert\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663308    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-trusted-ca-bundle\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663326    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-service-ca\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663679 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663395    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-config\") pod \"420f0acd-e908-4fcb-9e3e-585138fcb21a\" (UID: \"420f0acd-e908-4fcb-9e3e-585138fcb21a\") "
Sep 08 15:02:16.663812 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663786    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:16.663913 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663795    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:16.663974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663807    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-service-ca" (OuterVolumeSpecName: "service-ca") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:16.663974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.663957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-config" (OuterVolumeSpecName: "console-config") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:02:16.665308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.665290    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:16.665739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.665722    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:02:16.665802 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.665734    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420f0acd-e908-4fcb-9e3e-585138fcb21a-kube-api-access-tlhbj" (OuterVolumeSpecName: "kube-api-access-tlhbj") pod "420f0acd-e908-4fcb-9e3e-585138fcb21a" (UID: "420f0acd-e908-4fcb-9e3e-585138fcb21a"). InnerVolumeSpecName "kube-api-access-tlhbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:02:16.764549 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764525    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-oauth-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:16.764549 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764548    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:16.764686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764562    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlhbj\" (UniqueName: \"kubernetes.io/projected/420f0acd-e908-4fcb-9e3e-585138fcb21a-kube-api-access-tlhbj\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:16.764686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764574    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-oauth-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:16.764686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764586    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-trusted-ca-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:16.764686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764599    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:16.764686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:16.764612    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/420f0acd-e908-4fcb-9e3e-585138fcb21a-console-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:02:17.460760 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.460728    2579 generic.go:356] "Generic (PLEG): container finished" podID="420f0acd-e908-4fcb-9e3e-585138fcb21a" containerID="92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1" exitCode=0
Sep 08 15:02:17.461160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.460773    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf44db7c8-lkr2t"
Sep 08 15:02:17.461160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.460802    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf44db7c8-lkr2t" event={"ID":"420f0acd-e908-4fcb-9e3e-585138fcb21a","Type":"ContainerDied","Data":"92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1"}
Sep 08 15:02:17.461160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.460848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf44db7c8-lkr2t" event={"ID":"420f0acd-e908-4fcb-9e3e-585138fcb21a","Type":"ContainerDied","Data":"6c647dcfd1aa09db20144ac6419432fe2dc4648daac82319949293979418014a"}
Sep 08 15:02:17.461160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.460868    2579 scope.go:117] "RemoveContainer" containerID="92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1"
Sep 08 15:02:17.469351 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.469335    2579 scope.go:117] "RemoveContainer" containerID="92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1"
Sep 08 15:02:17.469619 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:02:17.469593    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1\": container with ID starting with 92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1 not found: ID does not exist" containerID="92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1"
Sep 08 15:02:17.469693 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.469619    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1"} err="failed to get container status \"92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1\": rpc error: code = NotFound desc = could not find container \"92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1\": container with ID starting with 92ef865b051becaf652844c7d98d23b6de4be6045198ab8fcfc08de474bb31a1 not found: ID does not exist"
Sep 08 15:02:17.478062 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.478042    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bf44db7c8-lkr2t"]
Sep 08 15:02:17.481857 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:17.481836    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bf44db7c8-lkr2t"]
Sep 08 15:02:19.387867 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:02:19.387836    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="420f0acd-e908-4fcb-9e3e-585138fcb21a" path="/var/lib/kubelet/pods/420f0acd-e908-4fcb-9e3e-585138fcb21a/volumes"
Sep 08 15:03:02.697050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:02.697015    2579 generic.go:356] "Generic (PLEG): container finished" podID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerID="9e94f016aa781609cf1602edd483f67271756072f2f06bcd880b08dc650c2df3" exitCode=0
Sep 08 15:03:02.697488 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:02.697101    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs" event={"ID":"922d292d-1368-4520-b03a-3c8e5c9593a4","Type":"ContainerDied","Data":"9e94f016aa781609cf1602edd483f67271756072f2f06bcd880b08dc650c2df3"}
Sep 08 15:03:03.704723 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:03.704689    2579 generic.go:356] "Generic (PLEG): container finished" podID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerID="6b2bcf2dbe3892bb89b7c000dbcdbc29831d2a333301d0f669deff05cf17c0a1" exitCode=0
Sep 08 15:03:03.705151 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:03.704757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs" event={"ID":"922d292d-1368-4520-b03a-3c8e5c9593a4","Type":"ContainerDied","Data":"6b2bcf2dbe3892bb89b7c000dbcdbc29831d2a333301d0f669deff05cf17c0a1"}
Sep 08 15:03:04.834298 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.834277    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:03:04.935907 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.935880    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vjfk\" (UniqueName: \"kubernetes.io/projected/922d292d-1368-4520-b03a-3c8e5c9593a4-kube-api-access-4vjfk\") pod \"922d292d-1368-4520-b03a-3c8e5c9593a4\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") "
Sep 08 15:03:04.936043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.935981    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-util\") pod \"922d292d-1368-4520-b03a-3c8e5c9593a4\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") "
Sep 08 15:03:04.936043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.936017    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-bundle\") pod \"922d292d-1368-4520-b03a-3c8e5c9593a4\" (UID: \"922d292d-1368-4520-b03a-3c8e5c9593a4\") "
Sep 08 15:03:04.936525 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.936499    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-bundle" (OuterVolumeSpecName: "bundle") pod "922d292d-1368-4520-b03a-3c8e5c9593a4" (UID: "922d292d-1368-4520-b03a-3c8e5c9593a4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:03:04.937947 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.937922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922d292d-1368-4520-b03a-3c8e5c9593a4-kube-api-access-4vjfk" (OuterVolumeSpecName: "kube-api-access-4vjfk") pod "922d292d-1368-4520-b03a-3c8e5c9593a4" (UID: "922d292d-1368-4520-b03a-3c8e5c9593a4"). InnerVolumeSpecName "kube-api-access-4vjfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:03:04.940609 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:04.940584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-util" (OuterVolumeSpecName: "util") pod "922d292d-1368-4520-b03a-3c8e5c9593a4" (UID: "922d292d-1368-4520-b03a-3c8e5c9593a4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:03:05.037246 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:05.037164    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:05.037246 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:05.037206    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vjfk\" (UniqueName: \"kubernetes.io/projected/922d292d-1368-4520-b03a-3c8e5c9593a4-kube-api-access-4vjfk\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:05.037246 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:05.037220    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/922d292d-1368-4520-b03a-3c8e5c9593a4-util\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:05.717256 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:05.717175    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs" event={"ID":"922d292d-1368-4520-b03a-3c8e5c9593a4","Type":"ContainerDied","Data":"61408376ec481765213bfe0a2aaea49e1b7babdebf48e6e4984dd61db5fbcbea"}
Sep 08 15:03:05.717256 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:05.717225    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61408376ec481765213bfe0a2aaea49e1b7babdebf48e6e4984dd61db5fbcbea"
Sep 08 15:03:05.717256 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:05.717188    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbl5mvs"
Sep 08 15:03:13.145329 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145293    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-mkbjc"]
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145637    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="pull"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145650    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="pull"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145659    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="pull"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145665    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="pull"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145673    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="util"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145679    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="util"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145686    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="util"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145691    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="util"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145698    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="extract"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145703    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="extract"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145710    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="pull"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145714    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="pull"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145729    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="util"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145735    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="util"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145742    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="extract"
Sep 08 15:03:13.145741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145748    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145754    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="util"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145759    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="util"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145764    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145769    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145776    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="pull"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145781    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="pull"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145788    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420f0acd-e908-4fcb-9e3e-585138fcb21a" containerName="console"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145792    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="420f0acd-e908-4fcb-9e3e-585138fcb21a" containerName="console"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145799    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145803    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145852    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc62068-696d-4163-ac1a-d4584e18e7a6" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145857    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0cfb3f7-a408-43fb-9838-044a0fe4982d" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145865    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3875fae-6936-4800-a32d-f4bd88cc2bbe" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145872    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="922d292d-1368-4520-b03a-3c8e5c9593a4" containerName="extract"
Sep 08 15:03:13.146211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.145879    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="420f0acd-e908-4fcb-9e3e-585138fcb21a" containerName="console"
Sep 08 15:03:13.150207 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.150190    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:13.152888 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.152867    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:03:13.153484 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.153468    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:03:13.153599 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.153584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-g45z8\""
Sep 08 15:03:13.159906 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.159879    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-mkbjc"]
Sep 08 15:03:13.298737 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.298702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klj5h\" (UniqueName: \"kubernetes.io/projected/b0b8ec63-9843-4291-b195-6b0b6439dbf4-kube-api-access-klj5h\") pod \"authorino-operator-68d88948d8-mkbjc\" (UID: \"b0b8ec63-9843-4291-b195-6b0b6439dbf4\") " pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:13.400083 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.399999    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klj5h\" (UniqueName: \"kubernetes.io/projected/b0b8ec63-9843-4291-b195-6b0b6439dbf4-kube-api-access-klj5h\") pod \"authorino-operator-68d88948d8-mkbjc\" (UID: \"b0b8ec63-9843-4291-b195-6b0b6439dbf4\") " pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:13.415401 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.415373    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klj5h\" (UniqueName: \"kubernetes.io/projected/b0b8ec63-9843-4291-b195-6b0b6439dbf4-kube-api-access-klj5h\") pod \"authorino-operator-68d88948d8-mkbjc\" (UID: \"b0b8ec63-9843-4291-b195-6b0b6439dbf4\") " pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:13.461218 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.461193    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:13.737686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.737661    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-mkbjc"]
Sep 08 15:03:13.739660 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:13.739631    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b8ec63_9843_4291_b195_6b0b6439dbf4.slice/crio-a046a544af55d43dc0a972ee26c890abf59d337e7cbbda904d61f9d287bcebd9 WatchSource:0}: Error finding container a046a544af55d43dc0a972ee26c890abf59d337e7cbbda904d61f9d287bcebd9: Status 404 returned error can't find the container with id a046a544af55d43dc0a972ee26c890abf59d337e7cbbda904d61f9d287bcebd9
Sep 08 15:03:13.758501 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:13.758472    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc" event={"ID":"b0b8ec63-9843-4291-b195-6b0b6439dbf4","Type":"ContainerStarted","Data":"a046a544af55d43dc0a972ee26c890abf59d337e7cbbda904d61f9d287bcebd9"}
Sep 08 15:03:16.776582 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:16.776488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc" event={"ID":"b0b8ec63-9843-4291-b195-6b0b6439dbf4","Type":"ContainerStarted","Data":"0016a47584ea7cd92d59315a9c59787d4cacafa053572e257075396db2de9d39"}
Sep 08 15:03:16.776928 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:16.776642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:16.798524 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:16.798479    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc" podStartSLOduration=1.020039238 podStartE2EDuration="3.798464714s" totalImagesPullingTime="2.778425476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:16.796203263 +0000 UTC m=+487.943224184" watchObservedRunningTime="2026-09-08 15:03:16.798464714 +0000 UTC m=+487.945485613"
Sep 08 15:03:17.439574 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.439542    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"]
Sep 08 15:03:17.442877 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.442862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.445327 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.445302    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2zmq6\""
Sep 08 15:03:17.456036 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.456009    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"]
Sep 08 15:03:17.536868 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.536832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b84b027-9e8c-4d54-962e-38bc2d706834-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.537029 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.536975    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xlx9\" (UniqueName: \"kubernetes.io/projected/0b84b027-9e8c-4d54-962e-38bc2d706834-kube-api-access-4xlx9\") pod \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.638313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.638279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xlx9\" (UniqueName: \"kubernetes.io/projected/0b84b027-9e8c-4d54-962e-38bc2d706834-kube-api-access-4xlx9\") pod \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.638483 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.638321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b84b027-9e8c-4d54-962e-38bc2d706834-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.638743 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.638723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b84b027-9e8c-4d54-962e-38bc2d706834-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.646974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.646951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xlx9\" (UniqueName: \"kubernetes.io/projected/0b84b027-9e8c-4d54-962e-38bc2d706834-kube-api-access-4xlx9\") pod \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:17.753108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:17.753034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:18.034495 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:18.034404    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"]
Sep 08 15:03:18.039299 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:18.039271    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b84b027_9e8c_4d54_962e_38bc2d706834.slice/crio-928c1bf41240615fb3bf2a20f48a38f9edd2ca8ca1e915eb404a921d20cb5b80 WatchSource:0}: Error finding container 928c1bf41240615fb3bf2a20f48a38f9edd2ca8ca1e915eb404a921d20cb5b80: Status 404 returned error can't find the container with id 928c1bf41240615fb3bf2a20f48a38f9edd2ca8ca1e915eb404a921d20cb5b80
Sep 08 15:03:18.788849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:18.788810    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk" event={"ID":"0b84b027-9e8c-4d54-962e-38bc2d706834","Type":"ContainerStarted","Data":"928c1bf41240615fb3bf2a20f48a38f9edd2ca8ca1e915eb404a921d20cb5b80"}
Sep 08 15:03:19.743353 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.743320    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"]
Sep 08 15:03:19.747864 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.747844    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:19.751963 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.751933    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 15:03:19.752169 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.752153    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9bndb\""
Sep 08 15:03:19.756116 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.756090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk582\" (UniqueName: \"kubernetes.io/projected/d636e1e3-1fd4-43b4-8eb2-dc0f616aa695-kube-api-access-wk582\") pod \"dns-operator-controller-manager-5985564776-vwmxb\" (UID: \"d636e1e3-1fd4-43b4-8eb2-dc0f616aa695\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:19.758091 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.758059    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"]
Sep 08 15:03:19.856563 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.856537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk582\" (UniqueName: \"kubernetes.io/projected/d636e1e3-1fd4-43b4-8eb2-dc0f616aa695-kube-api-access-wk582\") pod \"dns-operator-controller-manager-5985564776-vwmxb\" (UID: \"d636e1e3-1fd4-43b4-8eb2-dc0f616aa695\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:19.878775 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:19.878748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk582\" (UniqueName: \"kubernetes.io/projected/d636e1e3-1fd4-43b4-8eb2-dc0f616aa695-kube-api-access-wk582\") pod \"dns-operator-controller-manager-5985564776-vwmxb\" (UID: \"d636e1e3-1fd4-43b4-8eb2-dc0f616aa695\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:20.058557 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:20.058502    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:20.339332 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:20.339301    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"]
Sep 08 15:03:20.341035 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:20.340991    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd636e1e3_1fd4_43b4_8eb2_dc0f616aa695.slice/crio-b0bd55990b53408415f136f173724365b67baaef11551e271d9b321bdb514277 WatchSource:0}: Error finding container b0bd55990b53408415f136f173724365b67baaef11551e271d9b321bdb514277: Status 404 returned error can't find the container with id b0bd55990b53408415f136f173724365b67baaef11551e271d9b321bdb514277
Sep 08 15:03:20.800511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:20.800477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb" event={"ID":"d636e1e3-1fd4-43b4-8eb2-dc0f616aa695","Type":"ContainerStarted","Data":"b0bd55990b53408415f136f173724365b67baaef11551e271d9b321bdb514277"}
Sep 08 15:03:21.909101 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:21.909070    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"]
Sep 08 15:03:21.913105 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:21.913078    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:21.915665 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:21.915642    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7hfbv\""
Sep 08 15:03:21.926774 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:21.926747    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"]
Sep 08 15:03:21.970866 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:21.970835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5wk2\" (UniqueName: \"kubernetes.io/projected/82b4533f-52c5-4e0c-a51c-56049c4051e9-kube-api-access-d5wk2\") pod \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" (UID: \"82b4533f-52c5-4e0c-a51c-56049c4051e9\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:22.071473 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:22.071411    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wk2\" (UniqueName: \"kubernetes.io/projected/82b4533f-52c5-4e0c-a51c-56049c4051e9-kube-api-access-d5wk2\") pod \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" (UID: \"82b4533f-52c5-4e0c-a51c-56049c4051e9\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:22.082631 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:22.082596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wk2\" (UniqueName: \"kubernetes.io/projected/82b4533f-52c5-4e0c-a51c-56049c4051e9-kube-api-access-d5wk2\") pod \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" (UID: \"82b4533f-52c5-4e0c-a51c-56049c4051e9\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:22.229041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:22.228956    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:23.820303 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.820277    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk" event={"ID":"0b84b027-9e8c-4d54-962e-38bc2d706834","Type":"ContainerStarted","Data":"76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85"}
Sep 08 15:03:23.820646 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.820332    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:23.821959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.821938    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb" event={"ID":"d636e1e3-1fd4-43b4-8eb2-dc0f616aa695","Type":"ContainerStarted","Data":"17c3c4dc65ebdb1296079df505385976e53e0384bf9327cc14209dfa1cbd3f1f"}
Sep 08 15:03:23.822077 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.821994    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:23.843032 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.842990    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk" podStartSLOduration=1.183548604 podStartE2EDuration="6.842973655s" totalImagesPullingTime="5.659425051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:23.840646417 +0000 UTC m=+494.987667321" watchObservedRunningTime="2026-09-08 15:03:23.842973655 +0000 UTC m=+494.989994564"
Sep 08 15:03:23.963657 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.963560    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb" podStartSLOduration=1.6093519330000001 podStartE2EDuration="4.963540585s" totalImagesPullingTime="3.354188652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:23.868399542 +0000 UTC m=+495.015420471" watchObservedRunningTime="2026-09-08 15:03:23.963540585 +0000 UTC m=+495.110561492"
Sep 08 15:03:23.966124 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:23.966097    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"]
Sep 08 15:03:23.967442 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:23.967417    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b4533f_52c5_4e0c_a51c_56049c4051e9.slice/crio-9b87694af95cc6266057a3be98cd5f0d1e26fd4e801b48e442f2c03b22d825f9 WatchSource:0}: Error finding container 9b87694af95cc6266057a3be98cd5f0d1e26fd4e801b48e442f2c03b22d825f9: Status 404 returned error can't find the container with id 9b87694af95cc6266057a3be98cd5f0d1e26fd4e801b48e442f2c03b22d825f9
Sep 08 15:03:24.829741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:24.829698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt" event={"ID":"82b4533f-52c5-4e0c-a51c-56049c4051e9","Type":"ContainerStarted","Data":"9b87694af95cc6266057a3be98cd5f0d1e26fd4e801b48e442f2c03b22d825f9"}
Sep 08 15:03:25.837126 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:25.837044    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt" event={"ID":"82b4533f-52c5-4e0c-a51c-56049c4051e9","Type":"ContainerStarted","Data":"55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093"}
Sep 08 15:03:25.837546 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:25.837192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:25.855965 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:25.855919    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt" podStartSLOduration=3.362008277 podStartE2EDuration="4.855903211s" totalImagesPullingTime="1.493894934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:25.853736465 +0000 UTC m=+497.000757376" watchObservedRunningTime="2026-09-08 15:03:25.855903211 +0000 UTC m=+497.002924118"
Sep 08 15:03:27.784611 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:27.784571    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-mkbjc"
Sep 08 15:03:34.831864 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:34.831833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:34.832435 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:34.831912    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vwmxb"
Sep 08 15:03:36.845115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:36.845086    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.331910 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.331870    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"]
Sep 08 15:03:37.332143 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.332117    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk" podUID="0b84b027-9e8c-4d54-962e-38bc2d706834" containerName="manager" containerID="cri-o://76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85" gracePeriod=2
Sep 08 15:03:37.346315 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.346287    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"]
Sep 08 15:03:37.359018 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.358976    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"0b84b027-9e8c-4d54-962e-38bc2d706834\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-zgbtk\": pods \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:37.366026 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.365998    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"]
Sep 08 15:03:37.366430 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.366413    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b84b027-9e8c-4d54-962e-38bc2d706834" containerName="manager"
Sep 08 15:03:37.366534 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.366433    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b84b027-9e8c-4d54-962e-38bc2d706834" containerName="manager"
Sep 08 15:03:37.366534 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.366530    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b84b027-9e8c-4d54-962e-38bc2d706834" containerName="manager"
Sep 08 15:03:37.369579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.369557    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.373113 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.373085    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-zgbtk\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="0b84b027-9e8c-4d54-962e-38bc2d706834" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:37.390149 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.390120    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"]
Sep 08 15:03:37.394469 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.394420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fsmhb\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.394684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.394521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmtqv\" (UniqueName: \"kubernetes.io/projected/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-kube-api-access-cmtqv\") pod \"kuadrant-operator-controller-manager-58fc56757c-fsmhb\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.424731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.424705    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"]
Sep 08 15:03:37.424882 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.424860    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" containerName="manager" containerID="cri-o://55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093" gracePeriod=2
Sep 08 15:03:37.435411 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.435371    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"]
Sep 08 15:03:37.437203 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.437168    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"82b4533f-52c5-4e0c-a51c-56049c4051e9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-pc7kt\": pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.451981 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.451954    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"]
Sep 08 15:03:37.452537 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.452487    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" containerName="manager"
Sep 08 15:03:37.452537 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.452510    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" containerName="manager"
Sep 08 15:03:37.452738 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.452646    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" containerName="manager"
Sep 08 15:03:37.455922 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.455898    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:37.458242 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.458213    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.467274 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.467251    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"]
Sep 08 15:03:37.495582 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.495557    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmtqv\" (UniqueName: \"kubernetes.io/projected/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-kube-api-access-cmtqv\") pod \"kuadrant-operator-controller-manager-58fc56757c-fsmhb\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.495683 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.495614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6pzm\" (UniqueName: \"kubernetes.io/projected/70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b-kube-api-access-v6pzm\") pod \"limitador-operator-controller-manager-6c549b6d85-bjm7z\" (UID: \"70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:37.495759 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.495707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fsmhb\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.496074 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.496048    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-fsmhb\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.510014 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.509993    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmtqv\" (UniqueName: \"kubernetes.io/projected/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-kube-api-access-cmtqv\") pod \"kuadrant-operator-controller-manager-58fc56757c-fsmhb\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.597081 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.597050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6pzm\" (UniqueName: \"kubernetes.io/projected/70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b-kube-api-access-v6pzm\") pod \"limitador-operator-controller-manager-6c549b6d85-bjm7z\" (UID: \"70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:37.607471 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.607421    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6pzm\" (UniqueName: \"kubernetes.io/projected/70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b-kube-api-access-v6pzm\") pod \"limitador-operator-controller-manager-6c549b6d85-bjm7z\" (UID: \"70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:37.657002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.656979    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:37.659045 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.659018    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.659176 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.659163    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.661001 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.660977    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.698210 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.698189    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xlx9\" (UniqueName: \"kubernetes.io/projected/0b84b027-9e8c-4d54-962e-38bc2d706834-kube-api-access-4xlx9\") pod \"0b84b027-9e8c-4d54-962e-38bc2d706834\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") "
Sep 08 15:03:37.698279 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.698234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5wk2\" (UniqueName: \"kubernetes.io/projected/82b4533f-52c5-4e0c-a51c-56049c4051e9-kube-api-access-d5wk2\") pod \"82b4533f-52c5-4e0c-a51c-56049c4051e9\" (UID: \"82b4533f-52c5-4e0c-a51c-56049c4051e9\") "
Sep 08 15:03:37.698357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.698328    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b84b027-9e8c-4d54-962e-38bc2d706834-extensions-socket-volume\") pod \"0b84b027-9e8c-4d54-962e-38bc2d706834\" (UID: \"0b84b027-9e8c-4d54-962e-38bc2d706834\") "
Sep 08 15:03:37.698848 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.698825    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b84b027-9e8c-4d54-962e-38bc2d706834-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0b84b027-9e8c-4d54-962e-38bc2d706834" (UID: "0b84b027-9e8c-4d54-962e-38bc2d706834"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:03:37.700220 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.700192    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b84b027-9e8c-4d54-962e-38bc2d706834-kube-api-access-4xlx9" (OuterVolumeSpecName: "kube-api-access-4xlx9") pod "0b84b027-9e8c-4d54-962e-38bc2d706834" (UID: "0b84b027-9e8c-4d54-962e-38bc2d706834"). InnerVolumeSpecName "kube-api-access-4xlx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:03:37.700300 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.700245    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b4533f-52c5-4e0c-a51c-56049c4051e9-kube-api-access-d5wk2" (OuterVolumeSpecName: "kube-api-access-d5wk2") pod "82b4533f-52c5-4e0c-a51c-56049c4051e9" (UID: "82b4533f-52c5-4e0c-a51c-56049c4051e9"). InnerVolumeSpecName "kube-api-access-d5wk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:03:37.716396 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.716376    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:37.789353 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.789324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:37.799365 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.799281    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5wk2\" (UniqueName: \"kubernetes.io/projected/82b4533f-52c5-4e0c-a51c-56049c4051e9-kube-api-access-d5wk2\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:37.799365 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.799301    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0b84b027-9e8c-4d54-962e-38bc2d706834-extensions-socket-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:37.799365 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.799311    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xlx9\" (UniqueName: \"kubernetes.io/projected/0b84b027-9e8c-4d54-962e-38bc2d706834-kube-api-access-4xlx9\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:37.906058 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.906025    2579 generic.go:356] "Generic (PLEG): container finished" podID="0b84b027-9e8c-4d54-962e-38bc2d706834" containerID="76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85" exitCode=0
Sep 08 15:03:37.906410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.906073    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-zgbtk"
Sep 08 15:03:37.906410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.906124    2579 scope.go:117] "RemoveContainer" containerID="76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85"
Sep 08 15:03:37.907597 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.907577    2579 generic.go:356] "Generic (PLEG): container finished" podID="82b4533f-52c5-4e0c-a51c-56049c4051e9" containerID="55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093" exitCode=0
Sep 08 15:03:37.907706 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.907627    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.908123 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.908101    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.910001 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.909971    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.914744 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.914725    2579 scope.go:117] "RemoveContainer" containerID="76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85"
Sep 08 15:03:37.915012 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.914992    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85\": container with ID starting with 76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85 not found: ID does not exist" containerID="76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85"
Sep 08 15:03:37.915058 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.915021    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85"} err="failed to get container status \"76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85\": rpc error: code = NotFound desc = could not find container \"76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85\": container with ID starting with 76b580ce357c1f8fbc17c86b549513c9bf25575042001b986a67f2c055e2ce85 not found: ID does not exist"
Sep 08 15:03:37.915058 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.915038    2579 scope.go:117] "RemoveContainer" containerID="55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093"
Sep 08 15:03:37.920943 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.920918    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.922484 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.922443    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:37.923439 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.923423    2579 scope.go:117] "RemoveContainer" containerID="55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093"
Sep 08 15:03:37.923720 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:37.923704    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093\": container with ID starting with 55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093 not found: ID does not exist" containerID="55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093"
Sep 08 15:03:37.923787 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.923724    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093"} err="failed to get container status \"55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093\": rpc error: code = NotFound desc = could not find container \"55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093\": container with ID starting with 55ace6aac5ffc52d44f0145661c3c53b7e0d173a691b50b82e0eb043af98a093 not found: ID does not exist"
Sep 08 15:03:37.990186 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:37.990165    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"]
Sep 08 15:03:37.991747 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:37.991717    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede9bb1c_a159_4c42_ba7a_21c60fcd1ba6.slice/crio-87f7814429c923a11f3587d65ed11c971026b3bf2822117b5e4435fa457e9a1f WatchSource:0}: Error finding container 87f7814429c923a11f3587d65ed11c971026b3bf2822117b5e4435fa457e9a1f: Status 404 returned error can't find the container with id 87f7814429c923a11f3587d65ed11c971026b3bf2822117b5e4435fa457e9a1f
Sep 08 15:03:38.062364 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.062343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"]
Sep 08 15:03:38.063945 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:38.063920    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70c457fa_68b4_4b3e_bca8_1c17eb7a2d2b.slice/crio-cbd084d821c4280f3ee14dfdfabe8dcc24707ce8a1caf5998631c09cd6b01509 WatchSource:0}: Error finding container cbd084d821c4280f3ee14dfdfabe8dcc24707ce8a1caf5998631c09cd6b01509: Status 404 returned error can't find the container with id cbd084d821c4280f3ee14dfdfabe8dcc24707ce8a1caf5998631c09cd6b01509
Sep 08 15:03:38.916303 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.916266    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z" event={"ID":"70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b","Type":"ContainerStarted","Data":"8b8e1a9e6d7592307e4919900728247e260cd99d5173e351cadb4ff5dc1c4f90"}
Sep 08 15:03:38.916773 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.916332    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:38.916773 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.916356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z" event={"ID":"70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b","Type":"ContainerStarted","Data":"cbd084d821c4280f3ee14dfdfabe8dcc24707ce8a1caf5998631c09cd6b01509"}
Sep 08 15:03:38.918046 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.918021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb" event={"ID":"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6","Type":"ContainerStarted","Data":"fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0"}
Sep 08 15:03:38.918191 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.918067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:38.918191 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.918084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb" event={"ID":"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6","Type":"ContainerStarted","Data":"87f7814429c923a11f3587d65ed11c971026b3bf2822117b5e4435fa457e9a1f"}
Sep 08 15:03:38.918295 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:38.918271    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:38.934697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.934644    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z" podStartSLOduration=1.934631422 podStartE2EDuration="1.934631422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:38.93295605 +0000 UTC m=+510.079976970" watchObservedRunningTime="2026-09-08 15:03:38.934631422 +0000 UTC m=+510.081652330"
Sep 08 15:03:38.934795 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:38.934748    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:38.953989 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:38.953945    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb" podStartSLOduration=1.953933573 podStartE2EDuration="1.953933573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:38.952907085 +0000 UTC m=+510.099927993" watchObservedRunningTime="2026-09-08 15:03:38.953933573 +0000 UTC m=+510.100954479"
Sep 08 15:03:39.389272 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:39.389193    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b84b027-9e8c-4d54-962e-38bc2d706834" path="/var/lib/kubelet/pods/0b84b027-9e8c-4d54-962e-38bc2d706834/volumes"
Sep 08 15:03:39.389673 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:39.389649    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" path="/var/lib/kubelet/pods/82b4533f-52c5-4e0c-a51c-56049c4051e9/volumes"
Sep 08 15:03:39.391337 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:39.391307    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pc7kt\" is forbidden: User \"system:node:ip-10-0-137-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-101.ec2.internal' and this object" podUID="82b4533f-52c5-4e0c-a51c-56049c4051e9" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pc7kt"
Sep 08 15:03:49.925921 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:49.925887    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-bjm7z"
Sep 08 15:03:49.926479 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:49.926060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:57.768314 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:57.768280    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"]
Sep 08 15:03:57.768725 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:57.768490    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb" podUID="ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" containerName="manager" containerID="cri-o://fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0" gracePeriod=10
Sep 08 15:03:58.021647 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.021592    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:58.030001 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.029905    2579 generic.go:356] "Generic (PLEG): container finished" podID="ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" containerID="fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0" exitCode=0
Sep 08 15:03:58.030001 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.029970    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"
Sep 08 15:03:58.030175 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.030032    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb" event={"ID":"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6","Type":"ContainerDied","Data":"fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0"}
Sep 08 15:03:58.030175 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.030082    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb" event={"ID":"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6","Type":"ContainerDied","Data":"87f7814429c923a11f3587d65ed11c971026b3bf2822117b5e4435fa457e9a1f"}
Sep 08 15:03:58.030175 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.030113    2579 scope.go:117] "RemoveContainer" containerID="fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0"
Sep 08 15:03:58.038691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.038674    2579 scope.go:117] "RemoveContainer" containerID="fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0"
Sep 08 15:03:58.038969 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:03:58.038951    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0\": container with ID starting with fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0 not found: ID does not exist" containerID="fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0"
Sep 08 15:03:58.039017 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.038981    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0"} err="failed to get container status \"fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0\": rpc error: code = NotFound desc = could not find container \"fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0\": container with ID starting with fb695259bc2d71f945111e3b2af6b0a4e69ddd6eedb2503c5605ccfa51bbc7b0 not found: ID does not exist"
Sep 08 15:03:58.053025 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.053004    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"]
Sep 08 15:03:58.053387 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.053372    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" containerName="manager"
Sep 08 15:03:58.053387 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.053388    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" containerName="manager"
Sep 08 15:03:58.053523 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.053506    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" containerName="manager"
Sep 08 15:03:58.056634 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.056615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.075217 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.075195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"]
Sep 08 15:03:58.152159 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.152139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmtqv\" (UniqueName: \"kubernetes.io/projected/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-kube-api-access-cmtqv\") pod \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") "
Sep 08 15:03:58.152260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.152171    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-extensions-socket-volume\") pod \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\" (UID: \"ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6\") "
Sep 08 15:03:58.152260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.152235    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmtcf\" (UniqueName: \"kubernetes.io/projected/7023de6e-542e-4059-8397-ab9949b80487-kube-api-access-qmtcf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rfq2h\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.152339 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.152294    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7023de6e-542e-4059-8397-ab9949b80487-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rfq2h\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.152621 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.152600    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" (UID: "ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:03:58.154260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.154231    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-kube-api-access-cmtqv" (OuterVolumeSpecName: "kube-api-access-cmtqv") pod "ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" (UID: "ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6"). InnerVolumeSpecName "kube-api-access-cmtqv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:03:58.253116 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.253090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7023de6e-542e-4059-8397-ab9949b80487-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rfq2h\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.253209 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.253128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmtcf\" (UniqueName: \"kubernetes.io/projected/7023de6e-542e-4059-8397-ab9949b80487-kube-api-access-qmtcf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rfq2h\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.253209 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.253162    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmtqv\" (UniqueName: \"kubernetes.io/projected/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-kube-api-access-cmtqv\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:58.253290 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.253243    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6-extensions-socket-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:03:58.253470 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.253425    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7023de6e-542e-4059-8397-ab9949b80487-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rfq2h\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.262337 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.262308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmtcf\" (UniqueName: \"kubernetes.io/projected/7023de6e-542e-4059-8397-ab9949b80487-kube-api-access-qmtcf\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-rfq2h\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.353383 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.353352    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"]
Sep 08 15:03:58.356922 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.356903    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-fsmhb"]
Sep 08 15:03:58.367210 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.367167    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:58.667012 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:58.666988    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"]
Sep 08 15:03:58.669249 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:03:58.669223    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7023de6e_542e_4059_8397_ab9949b80487.slice/crio-282c8d8f45d90b7dff3b20131e4206ff74cee98b95f7f0b9c901161ff74ddf8c WatchSource:0}: Error finding container 282c8d8f45d90b7dff3b20131e4206ff74cee98b95f7f0b9c901161ff74ddf8c: Status 404 returned error can't find the container with id 282c8d8f45d90b7dff3b20131e4206ff74cee98b95f7f0b9c901161ff74ddf8c
Sep 08 15:03:59.038635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:59.038553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h" event={"ID":"7023de6e-542e-4059-8397-ab9949b80487","Type":"ContainerStarted","Data":"2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae"}
Sep 08 15:03:59.038635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:59.038615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h" event={"ID":"7023de6e-542e-4059-8397-ab9949b80487","Type":"ContainerStarted","Data":"282c8d8f45d90b7dff3b20131e4206ff74cee98b95f7f0b9c901161ff74ddf8c"}
Sep 08 15:03:59.039002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:59.038737    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:03:59.065278 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:59.065226    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h" podStartSLOduration=1.065205707 podStartE2EDuration="1.065205707s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:03:59.064842585 +0000 UTC m=+530.211863523" watchObservedRunningTime="2026-09-08 15:03:59.065205707 +0000 UTC m=+530.212226615"
Sep 08 15:03:59.389282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:03:59.389206    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6" path="/var/lib/kubelet/pods/ede9bb1c-a159-4c42-ba7a-21c60fcd1ba6/volumes"
Sep 08 15:04:10.045814 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:10.045773    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:04:38.370758 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.370707    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"]
Sep 08 15:04:38.373966 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.373944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.376655 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.376629    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 15:04:38.376780 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.376633    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:04:38.377289 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.377270    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jpw6w\""
Sep 08 15:04:38.377338 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.377309    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 15:04:38.382772 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.382748    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"]
Sep 08 15:04:38.467832 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.467801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7342e8ad-6bdf-4567-9595-0216ac008d96-data\") pod \"postgres-69fb4594cf-mn55d\" (UID: \"7342e8ad-6bdf-4567-9595-0216ac008d96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.467957 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.467851    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6c2l\" (UniqueName: \"kubernetes.io/projected/7342e8ad-6bdf-4567-9595-0216ac008d96-kube-api-access-n6c2l\") pod \"postgres-69fb4594cf-mn55d\" (UID: \"7342e8ad-6bdf-4567-9595-0216ac008d96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.569016 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.568990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7342e8ad-6bdf-4567-9595-0216ac008d96-data\") pod \"postgres-69fb4594cf-mn55d\" (UID: \"7342e8ad-6bdf-4567-9595-0216ac008d96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.569115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.569030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6c2l\" (UniqueName: \"kubernetes.io/projected/7342e8ad-6bdf-4567-9595-0216ac008d96-kube-api-access-n6c2l\") pod \"postgres-69fb4594cf-mn55d\" (UID: \"7342e8ad-6bdf-4567-9595-0216ac008d96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.569325 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.569306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7342e8ad-6bdf-4567-9595-0216ac008d96-data\") pod \"postgres-69fb4594cf-mn55d\" (UID: \"7342e8ad-6bdf-4567-9595-0216ac008d96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.578528 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.578500    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6c2l\" (UniqueName: \"kubernetes.io/projected/7342e8ad-6bdf-4567-9595-0216ac008d96-kube-api-access-n6c2l\") pod \"postgres-69fb4594cf-mn55d\" (UID: \"7342e8ad-6bdf-4567-9595-0216ac008d96\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.686814 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.686795    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:38.960373 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:38.960349    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"]
Sep 08 15:04:38.962005 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:04:38.961982    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7342e8ad_6bdf_4567_9595_0216ac008d96.slice/crio-7934e69a2c4da0fc2c63924a5316ee3e25043cad05af9e54865e93a2ca2caf18 WatchSource:0}: Error finding container 7934e69a2c4da0fc2c63924a5316ee3e25043cad05af9e54865e93a2ca2caf18: Status 404 returned error can't find the container with id 7934e69a2c4da0fc2c63924a5316ee3e25043cad05af9e54865e93a2ca2caf18
Sep 08 15:04:39.265477 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:39.265395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d" event={"ID":"7342e8ad-6bdf-4567-9595-0216ac008d96","Type":"ContainerStarted","Data":"7934e69a2c4da0fc2c63924a5316ee3e25043cad05af9e54865e93a2ca2caf18"}
Sep 08 15:04:44.308112 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:44.308074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d" event={"ID":"7342e8ad-6bdf-4567-9595-0216ac008d96","Type":"ContainerStarted","Data":"3ca993fb8bd86d6477c9b733e04825eaf627bbb252b5e85463708909a0f2b9df"}
Sep 08 15:04:44.308530 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:44.308135    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:04:44.326725 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:44.326678    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d" podStartSLOduration=1.7144286279999998 podStartE2EDuration="6.326664308s" totalImagesPullingTime="4.61223568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:04:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:04:44.322749078 +0000 UTC m=+575.469769985" watchObservedRunningTime="2026-09-08 15:04:44.326664308 +0000 UTC m=+575.473685215"
Sep 08 15:04:50.344849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:04:50.344808    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mn55d"
Sep 08 15:05:09.261599 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:09.261570    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:05:09.263122 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:09.263100    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:05:09.266511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:09.266488    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:05:09.267973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:09.267956    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:05:35.714774 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.714699    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"]
Sep 08 15:05:35.717971 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.717954    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:35.720221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.720200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-s67w9\""
Sep 08 15:05:35.720585 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.720569    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 15:05:35.732850 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.732825    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"]
Sep 08 15:05:35.823164 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.823128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlrfp\" (UniqueName: \"kubernetes.io/projected/e68bc3b2-e101-4f36-ab0d-9c8df0f9340a-kube-api-access-wlrfp\") pod \"payload-processing-5b54b7fbb7-dgtj8\" (UID: \"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:35.823313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.823183    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68bc3b2-e101-4f36-ab0d-9c8df0f9340a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-dgtj8\" (UID: \"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:35.924336 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.924296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlrfp\" (UniqueName: \"kubernetes.io/projected/e68bc3b2-e101-4f36-ab0d-9c8df0f9340a-kube-api-access-wlrfp\") pod \"payload-processing-5b54b7fbb7-dgtj8\" (UID: \"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:35.924549 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.924367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68bc3b2-e101-4f36-ab0d-9c8df0f9340a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-dgtj8\" (UID: \"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:35.925107 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.925080    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e68bc3b2-e101-4f36-ab0d-9c8df0f9340a-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-dgtj8\" (UID: \"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:35.932204 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:35.932180    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlrfp\" (UniqueName: \"kubernetes.io/projected/e68bc3b2-e101-4f36-ab0d-9c8df0f9340a-kube-api-access-wlrfp\") pod \"payload-processing-5b54b7fbb7-dgtj8\" (UID: \"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:36.027972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:36.027912    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:36.302730 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:36.302707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"]
Sep 08 15:05:36.304800 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:05:36.304772    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68bc3b2_e101_4f36_ab0d_9c8df0f9340a.slice/crio-45ce778fe80fc3fcb49d3042a8a83e0a6a7ac1761269cfbee74b0339973e1fd9 WatchSource:0}: Error finding container 45ce778fe80fc3fcb49d3042a8a83e0a6a7ac1761269cfbee74b0339973e1fd9: Status 404 returned error can't find the container with id 45ce778fe80fc3fcb49d3042a8a83e0a6a7ac1761269cfbee74b0339973e1fd9
Sep 08 15:05:36.312870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:36.312847    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:05:36.594948 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:36.594874    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8" event={"ID":"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a","Type":"ContainerStarted","Data":"45ce778fe80fc3fcb49d3042a8a83e0a6a7ac1761269cfbee74b0339973e1fd9"}
Sep 08 15:05:42.628187 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:42.628149    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8" event={"ID":"e68bc3b2-e101-4f36-ab0d-9c8df0f9340a","Type":"ContainerStarted","Data":"772f9b2857995ca3610bbddf795c5e6fe34c6a450f3f87291e9a504e7361dd19"}
Sep 08 15:05:42.628709 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:42.628284    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:05:42.651392 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:42.651321    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8" podStartSLOduration=1.8393675520000001 podStartE2EDuration="7.651303581s" totalImagesPullingTime="5.811936029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:05:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:05:42.650773811 +0000 UTC m=+633.797794716" watchObservedRunningTime="2026-09-08 15:05:42.651303581 +0000 UTC m=+633.798324489"
Sep 08 15:05:53.636528 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:05:53.636493    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-dgtj8"
Sep 08 15:06:16.987677 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:16.987642    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"]
Sep 08 15:06:16.991726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:16.991700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:16.994790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:16.994767    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:06:16.994895 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:16.994808    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 15:06:16.994895 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:16.994819    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mw2sm\""
Sep 08 15:06:16.995109 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:16.995092    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:06:17.001473 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.001436    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"]
Sep 08 15:06:17.054034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.054009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eccdf54-f714-482a-9956-551ccf4a54fc-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.054133 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.054066    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.054133 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.054090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.054133 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.054109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.054133 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.054122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.054293 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.054152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcwxv\" (UniqueName: \"kubernetes.io/projected/5eccdf54-f714-482a-9956-551ccf4a54fc-kube-api-access-rcwxv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155106 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155279    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155332    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcwxv\" (UniqueName: \"kubernetes.io/projected/5eccdf54-f714-482a-9956-551ccf4a54fc-kube-api-access-rcwxv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eccdf54-f714-482a-9956-551ccf4a54fc-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155633 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155507    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155642    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.155753 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.155710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.157656 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.157628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5eccdf54-f714-482a-9956-551ccf4a54fc-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.157976 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.157960    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5eccdf54-f714-482a-9956-551ccf4a54fc-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.163781 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.163758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcwxv\" (UniqueName: \"kubernetes.io/projected/5eccdf54-f714-482a-9956-551ccf4a54fc-kube-api-access-rcwxv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb\" (UID: \"5eccdf54-f714-482a-9956-551ccf4a54fc\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.305306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.305250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:17.579431 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.579409    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"]
Sep 08 15:06:17.581642 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:06:17.581615    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eccdf54_f714_482a_9956_551ccf4a54fc.slice/crio-376c44a9777c9698f3e33d97869c823d5f2a1759b7a8df621f9341820462cd4a WatchSource:0}: Error finding container 376c44a9777c9698f3e33d97869c823d5f2a1759b7a8df621f9341820462cd4a: Status 404 returned error can't find the container with id 376c44a9777c9698f3e33d97869c823d5f2a1759b7a8df621f9341820462cd4a
Sep 08 15:06:17.825812 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:17.825774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb" event={"ID":"5eccdf54-f714-482a-9956-551ccf4a54fc","Type":"ContainerStarted","Data":"376c44a9777c9698f3e33d97869c823d5f2a1759b7a8df621f9341820462cd4a"}
Sep 08 15:06:18.839697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:18.839599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb" event={"ID":"5eccdf54-f714-482a-9956-551ccf4a54fc","Type":"ContainerStarted","Data":"c2daac47ff7227dab85e502a7eec7f5a733ffe76d2c67e93ab7654bfdafa9755"}
Sep 08 15:06:27.306002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:27.305963    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:27.306433 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:27.306040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:27.318861 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:27.318837    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:06:27.338960 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:27.338917    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb" podStartSLOduration=10.361787748 podStartE2EDuration="11.338903816s" totalImagesPullingTime="977.116068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:06:18.87600058 +0000 UTC m=+670.023021515" watchObservedRunningTime="2026-09-08 15:06:27.338903816 +0000 UTC m=+678.485924720"
Sep 08 15:06:27.902579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:06:27.902549    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb"
Sep 08 15:08:33.725115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.725034    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"]
Sep 08 15:08:33.728741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.728721    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:33.731113 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.731095    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a1592f\""
Sep 08 15:08:33.738260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.738233    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"]
Sep 08 15:08:33.814150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.814114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f83295-c9f7-4009-a9a2-509ec3cc810f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:33.814285 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.814164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcfpv\" (UniqueName: \"kubernetes.io/projected/98f83295-c9f7-4009-a9a2-509ec3cc810f-kube-api-access-bcfpv\") pod \"payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:33.915101 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.915063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f83295-c9f7-4009-a9a2-509ec3cc810f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:33.915255 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.915125    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcfpv\" (UniqueName: \"kubernetes.io/projected/98f83295-c9f7-4009-a9a2-509ec3cc810f-kube-api-access-bcfpv\") pod \"payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:33.915777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.915756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f83295-c9f7-4009-a9a2-509ec3cc810f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:33.923868 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:33.923839    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcfpv\" (UniqueName: \"kubernetes.io/projected/98f83295-c9f7-4009-a9a2-509ec3cc810f-kube-api-access-bcfpv\") pod \"payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:34.040504 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:34.040423    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:34.318150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:34.318118    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"]
Sep 08 15:08:34.319431 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:08:34.319397    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f83295_c9f7_4009_a9a2_509ec3cc810f.slice/crio-6de14f1a987fec4add52a2287eec81d66e75cef8d6933e4dd466586a4711623e WatchSource:0}: Error finding container 6de14f1a987fec4add52a2287eec81d66e75cef8d6933e4dd466586a4711623e: Status 404 returned error can't find the container with id 6de14f1a987fec4add52a2287eec81d66e75cef8d6933e4dd466586a4711623e
Sep 08 15:08:34.611009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:34.610925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w" event={"ID":"98f83295-c9f7-4009-a9a2-509ec3cc810f","Type":"ContainerStarted","Data":"3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc"}
Sep 08 15:08:34.611009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:34.610990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w" event={"ID":"98f83295-c9f7-4009-a9a2-509ec3cc810f","Type":"ContainerStarted","Data":"6de14f1a987fec4add52a2287eec81d66e75cef8d6933e4dd466586a4711623e"}
Sep 08 15:08:34.611180 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:34.611023    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:34.629504 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:34.629430    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w" podStartSLOduration=1.62941661 podStartE2EDuration="1.62941661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:34.627925608 +0000 UTC m=+805.774946540" watchObservedRunningTime="2026-09-08 15:08:34.62941661 +0000 UTC m=+805.776437542"
Sep 08 15:08:36.637275 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.637244    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"]
Sep 08 15:08:36.640753 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.640735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.643260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.643235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4510c66e-openshift-default-dockercfg-t8j6j\""
Sep 08 15:08:36.653092 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.653072    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"]
Sep 08 15:08:36.742050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742023    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-data\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-envoy\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-credential-socket\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742114    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/918ec843-0266-409d-b61d-71305d5340b8-istio-podinfo\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742163 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqkd\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-kube-api-access-nhqkd\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742305 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742188    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-istio-token\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742305 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/918ec843-0266-409d-b61d-71305d5340b8-istiod-ca-cert\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742305 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-socket\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.742305 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.742289    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-certs\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843280 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-certs\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843391 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-data\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843391 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-envoy\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843391 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-credential-socket\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843391 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/918ec843-0266-409d-b61d-71305d5340b8-istio-podinfo\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843391 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqkd\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-kube-api-access-nhqkd\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-istio-token\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843433    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/918ec843-0266-409d-b61d-71305d5340b8-istiod-ca-cert\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843493    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-socket\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843865 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-certs\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843865 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-data\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843862    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-credential-socket\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.843974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.843904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-socket\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.844230 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.844209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/918ec843-0266-409d-b61d-71305d5340b8-istiod-ca-cert\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.845875 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.845846    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-envoy\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.846293 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.846229    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/918ec843-0266-409d-b61d-71305d5340b8-istio-podinfo\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.851607 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.851578    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-istio-token\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.852735 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.852712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqkd\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-kube-api-access-nhqkd\") pod \"e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") " pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:36.952681 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:36.952652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:37.233119 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:37.233090    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"]
Sep 08 15:08:37.234205 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:08:37.234179    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod918ec843_0266_409d_b61d_71305d5340b8.slice/crio-4512d60436eaa91f31c7ec89a3a5d633cb9b62a19a4ae57bf5a72836fd43b3cd WatchSource:0}: Error finding container 4512d60436eaa91f31c7ec89a3a5d633cb9b62a19a4ae57bf5a72836fd43b3cd: Status 404 returned error can't find the container with id 4512d60436eaa91f31c7ec89a3a5d633cb9b62a19a4ae57bf5a72836fd43b3cd
Sep 08 15:08:37.629842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:37.629759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" event={"ID":"918ec843-0266-409d-b61d-71305d5340b8","Type":"ContainerStarted","Data":"4512d60436eaa91f31c7ec89a3a5d633cb9b62a19a4ae57bf5a72836fd43b3cd"}
Sep 08 15:08:40.194838 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:40.194799    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:40.195128 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:40.194871    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:40.195128 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:40.194901    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:08:40.654135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:40.654097    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" event={"ID":"918ec843-0266-409d-b61d-71305d5340b8","Type":"ContainerStarted","Data":"b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"}
Sep 08 15:08:40.679766 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:40.679710    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podStartSLOduration=1.721591525 podStartE2EDuration="4.679697622s" totalImagesPullingTime="2.958106097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:40.677721792 +0000 UTC m=+811.824742700" watchObservedRunningTime="2026-09-08 15:08:40.679697622 +0000 UTC m=+811.826718528"
Sep 08 15:08:40.953340 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:40.953265    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:41.957737 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:41.957706    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:42.666164 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:42.666133    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:42.666947 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:42.666929    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:08:43.811127 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.811095    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"]
Sep 08 15:08:43.814852 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.814835    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:43.819292 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.819268    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-6b2b2e-dockercfg-szl27\""
Sep 08 15:08:43.819614 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.819598    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-6b2b2e\""
Sep 08 15:08:43.827735 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.827705    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"]
Sep 08 15:08:43.908433 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.908399    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/428f6407-3bf9-4d41-bb59-ed34449a90fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:43.908636 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:43.908569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ld42\" (UniqueName: \"kubernetes.io/projected/428f6407-3bf9-4d41-bb59-ed34449a90fa-kube-api-access-6ld42\") pod \"payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:44.009641 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.009601    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ld42\" (UniqueName: \"kubernetes.io/projected/428f6407-3bf9-4d41-bb59-ed34449a90fa-kube-api-access-6ld42\") pod \"payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:44.009782 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.009656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/428f6407-3bf9-4d41-bb59-ed34449a90fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:44.010347 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.010326    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/428f6407-3bf9-4d41-bb59-ed34449a90fa-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:44.021400 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.021370    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ld42\" (UniqueName: \"kubernetes.io/projected/428f6407-3bf9-4d41-bb59-ed34449a90fa-kube-api-access-6ld42\") pod \"payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:44.126240 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.126164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:44.402035 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.402013    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"]
Sep 08 15:08:44.403889 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:08:44.403861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428f6407_3bf9_4d41_bb59_ed34449a90fa.slice/crio-c2f91a5073a0fc52a8034742f98b71a155c0cf4611275c89c3fc673975947831 WatchSource:0}: Error finding container c2f91a5073a0fc52a8034742f98b71a155c0cf4611275c89c3fc673975947831: Status 404 returned error can't find the container with id c2f91a5073a0fc52a8034742f98b71a155c0cf4611275c89c3fc673975947831
Sep 08 15:08:44.679674 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.679594    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv" event={"ID":"428f6407-3bf9-4d41-bb59-ed34449a90fa","Type":"ContainerStarted","Data":"c97f0c741c26a9bbb18f433cb8a6373f75d0164a5a8f69d37eead26c3dc239ba"}
Sep 08 15:08:44.679674 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.679650    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv" event={"ID":"428f6407-3bf9-4d41-bb59-ed34449a90fa","Type":"ContainerStarted","Data":"c2f91a5073a0fc52a8034742f98b71a155c0cf4611275c89c3fc673975947831"}
Sep 08 15:08:44.695408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.695358    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv" podStartSLOduration=1.6953379480000002 podStartE2EDuration="1.695337948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:44.694814429 +0000 UTC m=+815.841835349" watchObservedRunningTime="2026-09-08 15:08:44.695337948 +0000 UTC m=+815.842358861"
Sep 08 15:08:44.777471 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.777402    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"]
Sep 08 15:08:44.781914 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.781755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:44.784427 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.784404    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4510c66e\""
Sep 08 15:08:44.784625 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.784465    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-4510c66e-dockercfg-cvmqz\""
Sep 08 15:08:44.789918 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.789896    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"]
Sep 08 15:08:44.920257 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.920221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfltw\" (UniqueName: \"kubernetes.io/projected/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-kube-api-access-wfltw\") pod \"payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") " pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:44.920638 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:44.920261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-plugins-config-volume\") pod \"payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") " pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.021505 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.021408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfltw\" (UniqueName: \"kubernetes.io/projected/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-kube-api-access-wfltw\") pod \"payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") " pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.021505 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.021477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-plugins-config-volume\") pod \"payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") " pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.022150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.022129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-plugins-config-volume\") pod \"payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") " pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.029808 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.029785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfltw\" (UniqueName: \"kubernetes.io/projected/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-kube-api-access-wfltw\") pod \"payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") " pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.094686 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.094655    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.372930 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.372901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"]
Sep 08 15:08:45.374819 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:08:45.374794    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b3e973_bfb1_46a7_8a62_cbd3a6ab7f6f.slice/crio-094792ea3a22edfe19d3eb186f66042037edd25f95ff5fa0c10ccddb9ff56740 WatchSource:0}: Error finding container 094792ea3a22edfe19d3eb186f66042037edd25f95ff5fa0c10ccddb9ff56740: Status 404 returned error can't find the container with id 094792ea3a22edfe19d3eb186f66042037edd25f95ff5fa0c10ccddb9ff56740
Sep 08 15:08:45.618659 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.618624    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:08:45.686975 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.686941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd" event={"ID":"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f","Type":"ContainerStarted","Data":"144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae"}
Sep 08 15:08:45.687148 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.687001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd" event={"ID":"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f","Type":"ContainerStarted","Data":"094792ea3a22edfe19d3eb186f66042037edd25f95ff5fa0c10ccddb9ff56740"}
Sep 08 15:08:45.687148 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.687115    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:08:45.687148 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.687149    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:45.701437 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:45.701389    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd" podStartSLOduration=1.7013699839999998 podStartE2EDuration="1.701369984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:08:45.701227213 +0000 UTC m=+816.848248118" watchObservedRunningTime="2026-09-08 15:08:45.701369984 +0000 UTC m=+816.848390913"
Sep 08 15:08:56.694888 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:56.694858    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:08:56.695251 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:08:56.694931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:09:01.813226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:01.813126    2579 generic.go:356] "Generic (PLEG): container finished" podID="918ec843-0266-409d-b61d-71305d5340b8" containerID="b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49" exitCode=0
Sep 08 15:09:01.813226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:01.813197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" event={"ID":"918ec843-0266-409d-b61d-71305d5340b8","Type":"ContainerDied","Data":"b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"}
Sep 08 15:09:01.813688 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:01.813600    2579 scope.go:117] "RemoveContainer" containerID="b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"
Sep 08 15:09:01.815549 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:01.815519    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:01.815626 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:01.815588    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:01.815626 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:01.815621    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:02.123853 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.123729    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"]
Sep 08 15:09:02.127355 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.127330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.129925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.129754    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-eba68d-serving-cert\""
Sep 08 15:09:02.129925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.129774    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:09:02.129925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.129850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-857r2\""
Sep 08 15:09:02.137699 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.137676    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"]
Sep 08 15:09:02.182250 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.182224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.182403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.182279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chshk\" (UniqueName: \"kubernetes.io/projected/6367b3b4-9dd2-4156-8202-9fe2525674f2-kube-api-access-chshk\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.182403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.182301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6367b3b4-9dd2-4156-8202-9fe2525674f2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.182403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.182379    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-metrics-certs\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.283650 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.283619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chshk\" (UniqueName: \"kubernetes.io/projected/6367b3b4-9dd2-4156-8202-9fe2525674f2-kube-api-access-chshk\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.283824 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.283656    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6367b3b4-9dd2-4156-8202-9fe2525674f2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.283824 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.283690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-metrics-certs\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.283824 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.283757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.283987 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:02.283849    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-serving-cert: secret "maas-api-e2e-inf-b-eba68d-serving-cert" not found
Sep 08 15:09:02.283987 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:02.283898    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls podName:6367b3b4-9dd2-4156-8202-9fe2525674f2 nodeName:}" failed. No retries permitted until 2026-09-08 15:09:02.783882925 +0000 UTC m=+833.930903811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls") pod "maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" (UID: "6367b3b4-9dd2-4156-8202-9fe2525674f2") : secret "maas-api-e2e-inf-b-eba68d-serving-cert" not found
Sep 08 15:09:02.284301 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.284271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6367b3b4-9dd2-4156-8202-9fe2525674f2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.286082 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.286057    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-metrics-certs\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.294974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.294951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chshk\" (UniqueName: \"kubernetes.io/projected/6367b3b4-9dd2-4156-8202-9fe2525674f2-kube-api-access-chshk\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.789214 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.789175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.791464 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.791424    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls\") pod \"maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:02.821985 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.821953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" event={"ID":"918ec843-0266-409d-b61d-71305d5340b8","Type":"ContainerStarted","Data":"1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6"}
Sep 08 15:09:02.952972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.952931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:09:02.953136 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.953108    2579 patch_prober.go:28] interesting pod/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:09:02.953192 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.953169    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 15:09:02.965808 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.965781    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"]
Sep 08 15:09:02.968443 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.968425    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:02.971004 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.970982    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-eba68d-dockercfg-6wqwx\""
Sep 08 15:09:02.971110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.971030    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-eba68d\""
Sep 08 15:09:02.981096 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.981073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"]
Sep 08 15:09:02.990761 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.990736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2dvs\" (UniqueName: \"kubernetes.io/projected/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-kube-api-access-z2dvs\") pod \"payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:02.990909 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:02.990891    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.044364 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.044294    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:03.093004 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.092965    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.094213 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.094187    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2dvs\" (UniqueName: \"kubernetes.io/projected/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-kube-api-access-z2dvs\") pod \"payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.094807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.094061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.114411 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.114258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2dvs\" (UniqueName: \"kubernetes.io/projected/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-kube-api-access-z2dvs\") pod \"payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.280585 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.280542    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.337080 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.336967    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"]
Sep 08 15:09:03.556568 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.556538    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"]
Sep 08 15:09:03.559010 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:09:03.558974    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc97a7c0d_7fcb_4442_a1e1_4e7f40d495c1.slice/crio-197ab639c0145cc6e7b2a777eb07740f4daa48f15a6c8efdf8046edb63d54837 WatchSource:0}: Error finding container 197ab639c0145cc6e7b2a777eb07740f4daa48f15a6c8efdf8046edb63d54837: Status 404 returned error can't find the container with id 197ab639c0145cc6e7b2a777eb07740f4daa48f15a6c8efdf8046edb63d54837
Sep 08 15:09:03.831329 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.831241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" event={"ID":"6367b3b4-9dd2-4156-8202-9fe2525674f2","Type":"ContainerStarted","Data":"b4fc36f16d558f1dbc0a83d1a8ddfd53d48574775c4b54817db6c26c952a9bf6"}
Sep 08 15:09:03.833386 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.833351    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh" event={"ID":"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1","Type":"ContainerStarted","Data":"24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df"}
Sep 08 15:09:03.833538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.833403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh" event={"ID":"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1","Type":"ContainerStarted","Data":"197ab639c0145cc6e7b2a777eb07740f4daa48f15a6c8efdf8046edb63d54837"}
Sep 08 15:09:03.833629 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.833613    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:03.960287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.959832    2579 patch_prober.go:28] interesting pod/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:09:03.960287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:03.959896    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 15:09:04.963473 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:04.961847    2579 patch_prober.go:28] interesting pod/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:09:04.963473 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:04.961923    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 15:09:05.965478 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:05.964809    2579 patch_prober.go:28] interesting pod/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:09:05.965478 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:05.964892    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 15:09:06.876789 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:06.876701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" event={"ID":"6367b3b4-9dd2-4156-8202-9fe2525674f2","Type":"ContainerStarted","Data":"d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb"}
Sep 08 15:09:06.876945 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:06.876779    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:06.896887 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:06.896833    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" podStartSLOduration=1.8459445159999999 podStartE2EDuration="4.896818715s" totalImagesPullingTime="3.050874199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:06.894086651 +0000 UTC m=+838.041107559" watchObservedRunningTime="2026-09-08 15:09:06.896818715 +0000 UTC m=+838.043839623"
Sep 08 15:09:06.897112 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:06.897093    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh" podStartSLOduration=4.897088232 podStartE2EDuration="4.897088232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:03.860778423 +0000 UTC m=+835.007799331" watchObservedRunningTime="2026-09-08 15:09:06.897088232 +0000 UTC m=+838.044109140"
Sep 08 15:09:06.953939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:06.953540    2579 patch_prober.go:28] interesting pod/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:09:06.953939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:06.953602    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 15:09:07.953356 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:07.953313    2579 patch_prober.go:28] interesting pod/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 08 15:09:07.953862 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:07.953379    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 08 15:09:08.956728 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:08.956697    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:09:08.957203 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:08.957183    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:09:08.958161 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:08.958134    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:09:12.889349 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:12.889322    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:09:14.843645 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:14.843606    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:09:24.020001 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.019968    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"]
Sep 08 15:09:24.020543 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.020175    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd" podUID="35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" containerName="payload-processing" containerID="cri-o://144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae" gracePeriod=30
Sep 08 15:09:24.275255 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.275195    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:09:24.348353 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.348322    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"]
Sep 08 15:09:24.348563 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.348538    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy" containerID="cri-o://1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6" gracePeriod=30
Sep 08 15:09:24.380641 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.380613    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfltw\" (UniqueName: \"kubernetes.io/projected/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-kube-api-access-wfltw\") pod \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") "
Sep 08 15:09:24.380782 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.380736    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-plugins-config-volume\") pod \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\" (UID: \"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f\") "
Sep 08 15:09:24.381075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.381050    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" (UID: "35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:24.382646 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.382619    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-kube-api-access-wfltw" (OuterVolumeSpecName: "kube-api-access-wfltw") pod "35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" (UID: "35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f"). InnerVolumeSpecName "kube-api-access-wfltw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:09:24.482162 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.482115    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-plugins-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:24.482162 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.482148    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfltw\" (UniqueName: \"kubernetes.io/projected/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f-kube-api-access-wfltw\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:24.993141 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.993102    2579 generic.go:356] "Generic (PLEG): container finished" podID="35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" containerID="144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae" exitCode=0
Sep 08 15:09:24.993141 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.993141    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"
Sep 08 15:09:24.993393 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.993174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd" event={"ID":"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f","Type":"ContainerDied","Data":"144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae"}
Sep 08 15:09:24.993393 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.993256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd" event={"ID":"35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f","Type":"ContainerDied","Data":"094792ea3a22edfe19d3eb186f66042037edd25f95ff5fa0c10ccddb9ff56740"}
Sep 08 15:09:24.993393 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:24.993286    2579 scope.go:117] "RemoveContainer" containerID="144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae"
Sep 08 15:09:25.002889 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.002871    2579 scope.go:117] "RemoveContainer" containerID="144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae"
Sep 08 15:09:25.003144 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:25.003123    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae\": container with ID starting with 144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae not found: ID does not exist" containerID="144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae"
Sep 08 15:09:25.003209 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.003157    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae"} err="failed to get container status \"144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae\": rpc error: code = NotFound desc = could not find container \"144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae\": container with ID starting with 144fec940dee369af9d42f344685dd4755651f272a3514d95231b6a728d7a1ae not found: ID does not exist"
Sep 08 15:09:25.014881 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.014857    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"]
Sep 08 15:09:25.021053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.021031    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-4510c66e-bffcd5987-s9npd"]
Sep 08 15:09:25.388560 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.388487    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" path="/var/lib/kubelet/pods/35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f/volumes"
Sep 08 15:09:25.467657 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.467631    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"]
Sep 08 15:09:25.468138 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.468122    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" containerName="payload-processing"
Sep 08 15:09:25.468199 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.468140    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" containerName="payload-processing"
Sep 08 15:09:25.468232 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.468227    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="35b3e973-bfb1-46a7-8a62-cbd3a6ab7f6f" containerName="payload-processing"
Sep 08 15:09:25.473203 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.473185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.475616 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.475597    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-b19c8836-gw-openshift-default-dockercfg-cx2lb\""
Sep 08 15:09:25.484834 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.484811    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"]
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-certs\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594321    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istiod-ca-cert\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-socket\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594407    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-credential-socket\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k5mq\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-kube-api-access-8k5mq\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-token\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594559    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-podinfo\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-data\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.600068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.594636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-envoy\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.695981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-envoy\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-certs\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istiod-ca-cert\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-socket\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-credential-socket\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k5mq\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-kube-api-access-8k5mq\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696145    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-token\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-podinfo\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-data\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696494 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696434    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-certs\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.696866 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696840    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-socket\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.697002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696879    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-credential-socket\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.697002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696913    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-data\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.697002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.696924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istiod-ca-cert\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.698386 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.698360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-envoy\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.698758 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.698740    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-podinfo\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.704344 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.704317    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-token\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.704464 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.704318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k5mq\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-kube-api-access-8k5mq\") pod \"e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") " pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:25.784814 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:25.784785    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:26.064862 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:26.064837    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"]
Sep 08 15:09:26.066556 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:09:26.066522    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbb3acf1_0dec_40bd_b785_02aa0c53a7e5.slice/crio-380fad63125691eab1b754a5b709f14f8a744a1563df881c22c4ae8492cee2ee WatchSource:0}: Error finding container 380fad63125691eab1b754a5b709f14f8a744a1563df881c22c4ae8492cee2ee: Status 404 returned error can't find the container with id 380fad63125691eab1b754a5b709f14f8a744a1563df881c22c4ae8492cee2ee
Sep 08 15:09:26.068695 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:26.068657    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:26.068869 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:26.068739    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:26.068869 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:26.068782    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:27.007688 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:27.007655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" event={"ID":"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5","Type":"ContainerStarted","Data":"60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"}
Sep 08 15:09:27.007836 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:27.007711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" event={"ID":"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5","Type":"ContainerStarted","Data":"380fad63125691eab1b754a5b709f14f8a744a1563df881c22c4ae8492cee2ee"}
Sep 08 15:09:27.030983 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:27.030936    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podStartSLOduration=2.030921284 podStartE2EDuration="2.030921284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:27.027797377 +0000 UTC m=+858.174818285" watchObservedRunningTime="2026-09-08 15:09:27.030921284 +0000 UTC m=+858.177942190"
Sep 08 15:09:27.785886 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:27.785856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:27.790511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:27.790487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:28.013791 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.013757    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:28.014767 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.014747    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:28.773065 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.773026    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"]
Sep 08 15:09:28.777590 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.777562    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:28.780039 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.780013    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-b19c8836-serving-cert\""
Sep 08 15:09:28.800174 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.800149    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"]
Sep 08 15:09:28.925434 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.925401    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-metrics-certs\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:28.925434 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.925437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:28.925656 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.925514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1343db-b13b-4bab-b1f4-8820ee26efdb-openshift-service-ca\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:28.925656 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:28.925591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb856\" (UniqueName: \"kubernetes.io/projected/6a1343db-b13b-4bab-b1f4-8820ee26efdb-kube-api-access-vb856\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.026974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.026889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb856\" (UniqueName: \"kubernetes.io/projected/6a1343db-b13b-4bab-b1f4-8820ee26efdb-kube-api-access-vb856\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.027126 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.027009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-metrics-certs\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.027126 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.027036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.027126 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.027072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1343db-b13b-4bab-b1f4-8820ee26efdb-openshift-service-ca\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.027283 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:29.027156    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-serving-cert: secret "maas-api-e2e-migrate-b19c8836-serving-cert" not found
Sep 08 15:09:29.027283 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:29.027214    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls podName:6a1343db-b13b-4bab-b1f4-8820ee26efdb nodeName:}" failed. No retries permitted until 2026-09-08 15:09:29.527197784 +0000 UTC m=+860.674218690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls") pod "maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" (UID: "6a1343db-b13b-4bab-b1f4-8820ee26efdb") : secret "maas-api-e2e-migrate-b19c8836-serving-cert" not found
Sep 08 15:09:29.027755 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.027723    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1343db-b13b-4bab-b1f4-8820ee26efdb-openshift-service-ca\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.029574 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.029551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-metrics-certs\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.039853 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.039827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb856\" (UniqueName: \"kubernetes.io/projected/6a1343db-b13b-4bab-b1f4-8820ee26efdb-kube-api-access-vb856\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.533374 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.533333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.536333 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.536306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls\") pod \"maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.558382 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.558357    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"]
Sep 08 15:09:29.562204 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.562186    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.564647 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.564627    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-b19c8836\""
Sep 08 15:09:29.564754 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.564627    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-b19c8836-dockercfg-lqpgg\""
Sep 08 15:09:29.580250 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.580226    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"]
Sep 08 15:09:29.604873 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.604799    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:09:29.635939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.635593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/defda336-3650-42b3-be6e-27a4f3f7d1c0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") " pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.635939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.635755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrj4k\" (UniqueName: \"kubernetes.io/projected/defda336-3650-42b3-be6e-27a4f3f7d1c0-kube-api-access-xrj4k\") pod \"payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") " pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.690526 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.690493    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:29.736436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-credential-socket\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736444    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/918ec843-0266-409d-b61d-71305d5340b8-istiod-ca-cert\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736703 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-istio-token\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736703 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736539    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-envoy\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736703 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736600    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-data\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736703 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736648    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:09:29.736703 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736657    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/918ec843-0266-409d-b61d-71305d5340b8-istio-podinfo\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhqkd\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-kube-api-access-nhqkd\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736792    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-socket\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736832    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-certs\") pod \"918ec843-0266-409d-b61d-71305d5340b8\" (UID: \"918ec843-0266-409d-b61d-71305d5340b8\") "
Sep 08 15:09:29.736973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736905    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/918ec843-0266-409d-b61d-71305d5340b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:29.736973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:09:29.737243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.736980    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrj4k\" (UniqueName: \"kubernetes.io/projected/defda336-3650-42b3-be6e-27a4f3f7d1c0-kube-api-access-xrj4k\") pod \"payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") " pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.737243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737075    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/defda336-3650-42b3-be6e-27a4f3f7d1c0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") " pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.737243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737083    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:09:29.737408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737281    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:09:29.737408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737341    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.737408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737364    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.737408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737379    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.737408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737395    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/918ec843-0266-409d-b61d-71305d5340b8-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.737917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.737835    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/defda336-3650-42b3-be6e-27a4f3f7d1c0-plugins-config-volume\") pod \"payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") " pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.739197 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.739164    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:09:29.739339 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.739318    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/918ec843-0266-409d-b61d-71305d5340b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:09:29.739415 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.739367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-kube-api-access-nhqkd" (OuterVolumeSpecName: "kube-api-access-nhqkd") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "kube-api-access-nhqkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:09:29.739596 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.739579    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "918ec843-0266-409d-b61d-71305d5340b8" (UID: "918ec843-0266-409d-b61d-71305d5340b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:09:29.745915 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.745724    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrj4k\" (UniqueName: \"kubernetes.io/projected/defda336-3650-42b3-be6e-27a4f3f7d1c0-kube-api-access-xrj4k\") pod \"payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") " pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.838220 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.838191    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/918ec843-0266-409d-b61d-71305d5340b8-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.838220 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.838217    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhqkd\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-kube-api-access-nhqkd\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.838220 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.838227    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.838634 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.838235    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/918ec843-0266-409d-b61d-71305d5340b8-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.838634 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.838242    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/918ec843-0266-409d-b61d-71305d5340b8-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:29.873006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.872978    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:29.969780 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:29.969756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"]
Sep 08 15:09:29.971090 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:09:29.971065    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1343db_b13b_4bab_b1f4_8820ee26efdb.slice/crio-59b826e8fbc4e3f172c8f17ad7693038ac6ff87a5801d36847d474b30f1d5155 WatchSource:0}: Error finding container 59b826e8fbc4e3f172c8f17ad7693038ac6ff87a5801d36847d474b30f1d5155: Status 404 returned error can't find the container with id 59b826e8fbc4e3f172c8f17ad7693038ac6ff87a5801d36847d474b30f1d5155
Sep 08 15:09:30.027424 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.027395    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" event={"ID":"6a1343db-b13b-4bab-b1f4-8820ee26efdb","Type":"ContainerStarted","Data":"59b826e8fbc4e3f172c8f17ad7693038ac6ff87a5801d36847d474b30f1d5155"}
Sep 08 15:09:30.029108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.029083    2579 generic.go:356] "Generic (PLEG): container finished" podID="918ec843-0266-409d-b61d-71305d5340b8" containerID="1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6" exitCode=0
Sep 08 15:09:30.029218 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.029143    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"
Sep 08 15:09:30.029218 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.029172    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" event={"ID":"918ec843-0266-409d-b61d-71305d5340b8","Type":"ContainerDied","Data":"1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6"}
Sep 08 15:09:30.029311 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.029227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx" event={"ID":"918ec843-0266-409d-b61d-71305d5340b8","Type":"ContainerDied","Data":"4512d60436eaa91f31c7ec89a3a5d633cb9b62a19a4ae57bf5a72836fd43b3cd"}
Sep 08 15:09:30.029311 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.029252    2579 scope.go:117] "RemoveContainer" containerID="1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6"
Sep 08 15:09:30.050185 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.050164    2579 scope.go:117] "RemoveContainer" containerID="b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"
Sep 08 15:09:30.059201 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.059182    2579 scope.go:117] "RemoveContainer" containerID="1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6"
Sep 08 15:09:30.059492 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:30.059472    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6\": container with ID starting with 1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6 not found: ID does not exist" containerID="1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6"
Sep 08 15:09:30.059580 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.059505    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6"} err="failed to get container status \"1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6\": rpc error: code = NotFound desc = could not find container \"1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6\": container with ID starting with 1bb7c4dd06473a7857589dc4f55a3d44759af2f294166b37e146457c147c6ec6 not found: ID does not exist"
Sep 08 15:09:30.059580 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.059528    2579 scope.go:117] "RemoveContainer" containerID="b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"
Sep 08 15:09:30.059823 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:09:30.059799    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49\": container with ID starting with b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49 not found: ID does not exist" containerID="b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"
Sep 08 15:09:30.059867 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.059831    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49"} err="failed to get container status \"b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49\": rpc error: code = NotFound desc = could not find container \"b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49\": container with ID starting with b6653251c46fba97de055e2fad8732ec3d5593dc56ddb5ce472caea9b509dc49 not found: ID does not exist"
Sep 08 15:09:30.064948 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.064903    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"]
Sep 08 15:09:30.067932 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.067912    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4510c66e-openshift-default-89875dd9b-hvlhx"]
Sep 08 15:09:30.143895 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:30.143873    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"]
Sep 08 15:09:30.145461 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:09:30.145432    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefda336_3650_42b3_be6e_27a4f3f7d1c0.slice/crio-5b4860f908d0a28087f5c4fbdd01a4164ee03cd74ea36b8c8cbac8a899b35df4 WatchSource:0}: Error finding container 5b4860f908d0a28087f5c4fbdd01a4164ee03cd74ea36b8c8cbac8a899b35df4: Status 404 returned error can't find the container with id 5b4860f908d0a28087f5c4fbdd01a4164ee03cd74ea36b8c8cbac8a899b35df4
Sep 08 15:09:31.036442 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.036406    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" event={"ID":"6a1343db-b13b-4bab-b1f4-8820ee26efdb","Type":"ContainerStarted","Data":"25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1"}
Sep 08 15:09:31.036911 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.036592    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:31.038003 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.037979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn" event={"ID":"defda336-3650-42b3-be6e-27a4f3f7d1c0","Type":"ContainerStarted","Data":"9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5"}
Sep 08 15:09:31.038113 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.038022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn" event={"ID":"defda336-3650-42b3-be6e-27a4f3f7d1c0","Type":"ContainerStarted","Data":"5b4860f908d0a28087f5c4fbdd01a4164ee03cd74ea36b8c8cbac8a899b35df4"}
Sep 08 15:09:31.038113 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.038048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:31.056247 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.056204    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" podStartSLOduration=2.746289829 podStartE2EDuration="3.056191729s" totalImagesPullingTime="309.9019ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:31.053947788 +0000 UTC m=+862.200968697" watchObservedRunningTime="2026-09-08 15:09:31.056191729 +0000 UTC m=+862.203212648"
Sep 08 15:09:31.391873 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:31.391836    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="918ec843-0266-409d-b61d-71305d5340b8" path="/var/lib/kubelet/pods/918ec843-0266-409d-b61d-71305d5340b8/volumes"
Sep 08 15:09:37.061727 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:37.061685    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:37.083279 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:37.083235    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn" podStartSLOduration=8.083220533 podStartE2EDuration="8.083220533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:09:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:09:31.071651998 +0000 UTC m=+862.218672931" watchObservedRunningTime="2026-09-08 15:09:37.083220533 +0000 UTC m=+868.230241443"
Sep 08 15:09:42.047818 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:42.047788    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:43.153394 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:43.153363    2579 patch_prober.go:28] interesting pod/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:39932->10.132.0.57:15021: read: connection reset by peer" start-of-body=
Sep 08 15:09:43.153870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:43.153430    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:39932->10.132.0.57:15021: read: connection reset by peer"
Sep 08 15:09:44.129573 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:44.129541    2579 generic.go:356] "Generic (PLEG): container finished" podID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerID="60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd" exitCode=0
Sep 08 15:09:44.129742 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:44.129625    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" event={"ID":"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5","Type":"ContainerDied","Data":"60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"}
Sep 08 15:09:44.130014 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:44.130001    2579 scope.go:117] "RemoveContainer" containerID="60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"
Sep 08 15:09:44.131080 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:44.131050    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:44.131143 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:44.131121    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:44.131179 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:44.131155    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:09:45.139107 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:45.139075    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" event={"ID":"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5","Type":"ContainerStarted","Data":"b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589"}
Sep 08 15:09:45.785402 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:45.785338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:45.785695 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:45.785671    2579 patch_prober.go:28] interesting pod/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:09:45.785783 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:45.785724    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 08 15:09:46.785276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:46.785243    2579 patch_prober.go:28] interesting pod/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:09:46.785690 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:46.785305    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 08 15:09:47.785428 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:47.785388    2579 patch_prober.go:28] interesting pod/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:09:47.785817 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:47.785479    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 08 15:09:48.785776 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:48.785742    2579 patch_prober.go:28] interesting pod/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:09:48.786140 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:48.785809    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 08 15:09:49.785255 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:49.785219    2579 patch_prober.go:28] interesting pod/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 08 15:09:49.785424 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:49.785273    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 08 15:09:50.935779 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:50.935739    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:50.936750 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:50.936721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:50.938490 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:50.938463    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:09:59.489390 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.489348    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"]
Sep 08 15:09:59.489874 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.489616    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" podUID="6a1343db-b13b-4bab-b1f4-8820ee26efdb" containerName="maas-api" containerID="cri-o://25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1" gracePeriod=30
Sep 08 15:09:59.567691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.567661    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"]
Sep 08 15:09:59.568059 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.567923    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn" podUID="defda336-3650-42b3-be6e-27a4f3f7d1c0" containerName="payload-processing" containerID="cri-o://9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5" gracePeriod=30
Sep 08 15:09:59.813516 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.813489    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:09:59.843727 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.843697    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:09:59.896316 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.896283    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"]
Sep 08 15:09:59.896588 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.896558    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy" containerID="cri-o://b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589" gracePeriod=30
Sep 08 15:09:59.905022 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.904994    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/defda336-3650-42b3-be6e-27a4f3f7d1c0-plugins-config-volume\") pod \"defda336-3650-42b3-be6e-27a4f3f7d1c0\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") "
Sep 08 15:09:59.905150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905041    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1343db-b13b-4bab-b1f4-8820ee26efdb-openshift-service-ca\") pod \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") "
Sep 08 15:09:59.905150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905074    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb856\" (UniqueName: \"kubernetes.io/projected/6a1343db-b13b-4bab-b1f4-8820ee26efdb-kube-api-access-vb856\") pod \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") "
Sep 08 15:09:59.905150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905132    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-metrics-certs\") pod \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") "
Sep 08 15:09:59.905340 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905157    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls\") pod \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\" (UID: \"6a1343db-b13b-4bab-b1f4-8820ee26efdb\") "
Sep 08 15:09:59.905340 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrj4k\" (UniqueName: \"kubernetes.io/projected/defda336-3650-42b3-be6e-27a4f3f7d1c0-kube-api-access-xrj4k\") pod \"defda336-3650-42b3-be6e-27a4f3f7d1c0\" (UID: \"defda336-3650-42b3-be6e-27a4f3f7d1c0\") "
Sep 08 15:09:59.905796 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905420    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a1343db-b13b-4bab-b1f4-8820ee26efdb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a1343db-b13b-4bab-b1f4-8820ee26efdb" (UID: "6a1343db-b13b-4bab-b1f4-8820ee26efdb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:59.905796 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905685    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a1343db-b13b-4bab-b1f4-8820ee26efdb-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:09:59.905796 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.905715    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defda336-3650-42b3-be6e-27a4f3f7d1c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "defda336-3650-42b3-be6e-27a4f3f7d1c0" (UID: "defda336-3650-42b3-be6e-27a4f3f7d1c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:09:59.908026 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.907998    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a1343db-b13b-4bab-b1f4-8820ee26efdb-kube-api-access-vb856" (OuterVolumeSpecName: "kube-api-access-vb856") pod "6a1343db-b13b-4bab-b1f4-8820ee26efdb" (UID: "6a1343db-b13b-4bab-b1f4-8820ee26efdb"). InnerVolumeSpecName "kube-api-access-vb856". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:09:59.908135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.908055    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a1343db-b13b-4bab-b1f4-8820ee26efdb" (UID: "6a1343db-b13b-4bab-b1f4-8820ee26efdb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:09:59.908135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.908124    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defda336-3650-42b3-be6e-27a4f3f7d1c0-kube-api-access-xrj4k" (OuterVolumeSpecName: "kube-api-access-xrj4k") pod "defda336-3650-42b3-be6e-27a4f3f7d1c0" (UID: "defda336-3650-42b3-be6e-27a4f3f7d1c0"). InnerVolumeSpecName "kube-api-access-xrj4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:09:59.908431 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:09:59.908411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6a1343db-b13b-4bab-b1f4-8820ee26efdb" (UID: "6a1343db-b13b-4bab-b1f4-8820ee26efdb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:10:00.006410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.006380    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/defda336-3650-42b3-be6e-27a4f3f7d1c0-plugins-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:00.006410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.006404    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb856\" (UniqueName: \"kubernetes.io/projected/6a1343db-b13b-4bab-b1f4-8820ee26efdb-kube-api-access-vb856\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:00.006410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.006413    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:00.006670 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.006421    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a1343db-b13b-4bab-b1f4-8820ee26efdb-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:00.006670 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.006429    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrj4k\" (UniqueName: \"kubernetes.io/projected/defda336-3650-42b3-be6e-27a4f3f7d1c0-kube-api-access-xrj4k\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:00.246039 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.245995    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a1343db-b13b-4bab-b1f4-8820ee26efdb" containerID="25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1" exitCode=0
Sep 08 15:10:00.246221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.246098    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" event={"ID":"6a1343db-b13b-4bab-b1f4-8820ee26efdb","Type":"ContainerDied","Data":"25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1"}
Sep 08 15:10:00.246221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.246153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt" event={"ID":"6a1343db-b13b-4bab-b1f4-8820ee26efdb","Type":"ContainerDied","Data":"59b826e8fbc4e3f172c8f17ad7693038ac6ff87a5801d36847d474b30f1d5155"}
Sep 08 15:10:00.246221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.246183    2579 scope.go:117] "RemoveContainer" containerID="25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1"
Sep 08 15:10:00.246393 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.246352    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"
Sep 08 15:10:00.249073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.249043    2579 generic.go:356] "Generic (PLEG): container finished" podID="defda336-3650-42b3-be6e-27a4f3f7d1c0" containerID="9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5" exitCode=0
Sep 08 15:10:00.249211 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.249076    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"
Sep 08 15:10:00.249278 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.249233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn" event={"ID":"defda336-3650-42b3-be6e-27a4f3f7d1c0","Type":"ContainerDied","Data":"9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5"}
Sep 08 15:10:00.249278 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.249273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn" event={"ID":"defda336-3650-42b3-be6e-27a4f3f7d1c0","Type":"ContainerDied","Data":"5b4860f908d0a28087f5c4fbdd01a4164ee03cd74ea36b8c8cbac8a899b35df4"}
Sep 08 15:10:00.259244 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.259127    2579 scope.go:117] "RemoveContainer" containerID="25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1"
Sep 08 15:10:00.259633 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:00.259606    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1\": container with ID starting with 25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1 not found: ID does not exist" containerID="25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1"
Sep 08 15:10:00.259710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.259660    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1"} err="failed to get container status \"25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1\": rpc error: code = NotFound desc = could not find container \"25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1\": container with ID starting with 25f310ceacc079af74c83179562184832962998a49fd99e401979b9239cdbbe1 not found: ID does not exist"
Sep 08 15:10:00.259710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.259684    2579 scope.go:117] "RemoveContainer" containerID="9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5"
Sep 08 15:10:00.267862 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.267843    2579 scope.go:117] "RemoveContainer" containerID="9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5"
Sep 08 15:10:00.268101 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:00.268081    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5\": container with ID starting with 9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5 not found: ID does not exist" containerID="9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5"
Sep 08 15:10:00.268158 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.268112    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5"} err="failed to get container status \"9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5\": rpc error: code = NotFound desc = could not find container \"9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5\": container with ID starting with 9d22373b6f1470adb2309a83c192b9c1662618fcc59dea66d72604338cfa8be5 not found: ID does not exist"
Sep 08 15:10:00.275635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.275614    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"]
Sep 08 15:10:00.280436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.280410    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-b19c8836-7d7df4bd98-78ttt"]
Sep 08 15:10:00.289923 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.289903    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"]
Sep 08 15:10:00.297152 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.297133    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-b19c8836-69dcbf78cd-2s8vn"]
Sep 08 15:10:00.656357 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.656318    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"]
Sep 08 15:10:00.656963 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.656942    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.656966    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.656980    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.656989    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657001    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="defda336-3650-42b3-be6e-27a4f3f7d1c0" containerName="payload-processing"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657012    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="defda336-3650-42b3-be6e-27a4f3f7d1c0" containerName="payload-processing"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657048    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a1343db-b13b-4bab-b1f4-8820ee26efdb" containerName="maas-api"
Sep 08 15:10:00.657115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657056    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a1343db-b13b-4bab-b1f4-8820ee26efdb" containerName="maas-api"
Sep 08 15:10:00.657472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657168    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="defda336-3650-42b3-be6e-27a4f3f7d1c0" containerName="payload-processing"
Sep 08 15:10:00.657472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657182    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a1343db-b13b-4bab-b1f4-8820ee26efdb" containerName="maas-api"
Sep 08 15:10:00.657472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657194    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy"
Sep 08 15:10:00.657472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.657204    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="918ec843-0266-409d-b61d-71305d5340b8" containerName="istio-proxy"
Sep 08 15:10:00.660464 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.660430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.662870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.662850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cc8fbdcf-openshift-default-dockercfg-ndqcq\""
Sep 08 15:10:00.671855 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.671833    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"]
Sep 08 15:10:00.713497 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-credential-socket\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713497 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713495    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-podinfo\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713660 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713540    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-token\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713660 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713593    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-data\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713660 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713614    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p526j\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-kube-api-access-p526j\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713660 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-envoy\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713813 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-socket\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713813 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713733    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istiod-ca-cert\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.713813 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.713786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-certs\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815021 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.814931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p526j\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-kube-api-access-p526j\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815021 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.814987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-envoy\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815021 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815019    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-socket\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istiod-ca-cert\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-certs\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-credential-socket\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-podinfo\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-token\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815244    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-data\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-socket\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-certs\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815875 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istiod-ca-cert\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815954 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815892    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-credential-socket\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.815954 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.815914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-data\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.817485 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.817464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-envoy\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.817715 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.817696    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-podinfo\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.822984 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.822964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-token\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.823372 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.823355    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p526j\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-kube-api-access-p526j\") pod \"e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") " pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:00.971579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:00.971539    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:01.250458 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:01.250402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"]
Sep 08 15:10:01.251961 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:10:01.251937    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90817d9_4b8c_4a9d_8287_c37cc14f66ef.slice/crio-cbea23680cd29911239066205b1bcef6d7926771188f641f3b7b8ee4e1308a3c WatchSource:0}: Error finding container cbea23680cd29911239066205b1bcef6d7926771188f641f3b7b8ee4e1308a3c: Status 404 returned error can't find the container with id cbea23680cd29911239066205b1bcef6d7926771188f641f3b7b8ee4e1308a3c
Sep 08 15:10:01.254087 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:01.254056    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:01.254171 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:01.254116    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:01.254171 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:01.254146    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:01.390728 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:01.390697    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a1343db-b13b-4bab-b1f4-8820ee26efdb" path="/var/lib/kubelet/pods/6a1343db-b13b-4bab-b1f4-8820ee26efdb/volumes"
Sep 08 15:10:01.391082 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:01.391064    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="defda336-3650-42b3-be6e-27a4f3f7d1c0" path="/var/lib/kubelet/pods/defda336-3650-42b3-be6e-27a4f3f7d1c0/volumes"
Sep 08 15:10:02.264147 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:02.264072    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" event={"ID":"a90817d9-4b8c-4a9d-8287-c37cc14f66ef","Type":"ContainerStarted","Data":"858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"}
Sep 08 15:10:02.264147 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:02.264146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" event={"ID":"a90817d9-4b8c-4a9d-8287-c37cc14f66ef","Type":"ContainerStarted","Data":"cbea23680cd29911239066205b1bcef6d7926771188f641f3b7b8ee4e1308a3c"}
Sep 08 15:10:02.284348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:02.284301    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podStartSLOduration=2.284286699 podStartE2EDuration="2.284286699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:02.28188597 +0000 UTC m=+893.428906902" watchObservedRunningTime="2026-09-08 15:10:02.284286699 +0000 UTC m=+893.431307606"
Sep 08 15:10:02.972604 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:02.972566    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:02.977262 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:02.977241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:03.270392 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:03.270318    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:03.271152 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:03.271132    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:04.733963 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.733932    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"]
Sep 08 15:10:04.738368 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.738339    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.740812 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.740788    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cc8fbdcf-serving-cert\""
Sep 08 15:10:04.749299 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.748920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"]
Sep 08 15:10:04.851182 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.851138    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-maas-api-tls\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.851346 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.851207    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8xq\" (UniqueName: \"kubernetes.io/projected/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-kube-api-access-gg8xq\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.851346 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.851256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-openshift-service-ca\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.851346 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.851285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-metrics-certs\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.952781 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.952744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-openshift-service-ca\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.952925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.952807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-metrics-certs\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.952925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.952907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-maas-api-tls\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.953054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.952987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8xq\" (UniqueName: \"kubernetes.io/projected/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-kube-api-access-gg8xq\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.953593 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.953562    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-openshift-service-ca\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.955438 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.955415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-maas-api-tls\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.955572 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.955489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-metrics-certs\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:04.961477 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:04.961430    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8xq\" (UniqueName: \"kubernetes.io/projected/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-kube-api-access-gg8xq\") pod \"maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:05.054514 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.054477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:05.166073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.166046    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:10:05.255035 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255001    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k5mq\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-kube-api-access-8k5mq\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255047    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-certs\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-credential-socket\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-podinfo\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255170    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istiod-ca-cert\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255199    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-envoy\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-socket\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-token\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255347    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-data\") pod \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\" (UID: \"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5\") "
Sep 08 15:10:05.255521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255426    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:05.255724 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255515    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:05.255724 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255628    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:05.255724 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255665    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:05.255902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255771    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.255902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255793    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.255902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255807    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.255902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255822    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.255902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.255885    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:05.257726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.257699    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:05.257726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.257701    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-kube-api-access-8k5mq" (OuterVolumeSpecName: "kube-api-access-8k5mq") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "kube-api-access-8k5mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:05.257862 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.257728    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:05.257902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.257855    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" (UID: "cbb3acf1-0dec-40bd-b785-02aa0c53a7e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:10:05.282986 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.282921    2579 generic.go:356] "Generic (PLEG): container finished" podID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerID="b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589" exitCode=0
Sep 08 15:10:05.282986 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.282963    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"
Sep 08 15:10:05.283122 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.283000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" event={"ID":"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5","Type":"ContainerDied","Data":"b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589"}
Sep 08 15:10:05.283122 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.283049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz" event={"ID":"cbb3acf1-0dec-40bd-b785-02aa0c53a7e5","Type":"ContainerDied","Data":"380fad63125691eab1b754a5b709f14f8a744a1563df881c22c4ae8492cee2ee"}
Sep 08 15:10:05.283122 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.283072    2579 scope.go:117] "RemoveContainer" containerID="b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589"
Sep 08 15:10:05.292705 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.292688    2579 scope.go:117] "RemoveContainer" containerID="60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"
Sep 08 15:10:05.301208 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.301191    2579 scope.go:117] "RemoveContainer" containerID="b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589"
Sep 08 15:10:05.301495 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:05.301474    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589\": container with ID starting with b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589 not found: ID does not exist" containerID="b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589"
Sep 08 15:10:05.301591 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.301500    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589"} err="failed to get container status \"b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589\": rpc error: code = NotFound desc = could not find container \"b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589\": container with ID starting with b79efacbbce35ccb926dc25d5d900e94aeeeb24457af5c0677281e01bec92589 not found: ID does not exist"
Sep 08 15:10:05.301591 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.301516    2579 scope.go:117] "RemoveContainer" containerID="60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"
Sep 08 15:10:05.301739 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:05.301722    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd\": container with ID starting with 60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd not found: ID does not exist" containerID="60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"
Sep 08 15:10:05.301784 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.301744    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd"} err="failed to get container status \"60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd\": rpc error: code = NotFound desc = could not find container \"60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd\": container with ID starting with 60f193e1a697834650198c6629813cb0598f8136c193479781463507612321bd not found: ID does not exist"
Sep 08 15:10:05.309270 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.309251    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"]
Sep 08 15:10:05.328832 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.328617    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-b19c8836-gw-openshift-default-9655c48d4-z22hz"]
Sep 08 15:10:05.342017 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.341989    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"]
Sep 08 15:10:05.343425 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:10:05.343389    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3b16ff2_0a7d_49b8_b4f5_10c53763f211.slice/crio-34526ee61fba117faadc64b8e4d8ed938ecdff4576325293d60b9b9b1992ac7a WatchSource:0}: Error finding container 34526ee61fba117faadc64b8e4d8ed938ecdff4576325293d60b9b9b1992ac7a: Status 404 returned error can't find the container with id 34526ee61fba117faadc64b8e4d8ed938ecdff4576325293d60b9b9b1992ac7a
Sep 08 15:10:05.357375 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.357344    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.357375 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.357372    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.357563 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.357476    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k5mq\" (UniqueName: \"kubernetes.io/projected/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-kube-api-access-8k5mq\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.357563 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.357494    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.357563 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.357510    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:05.391293 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.391256    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" path="/var/lib/kubelet/pods/cbb3acf1-0dec-40bd-b785-02aa0c53a7e5/volumes"
Sep 08 15:10:05.470754 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.470725    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"]
Sep 08 15:10:05.471312 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.471290    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy"
Sep 08 15:10:05.471312 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.471311    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy"
Sep 08 15:10:05.471523 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.471341    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy"
Sep 08 15:10:05.471523 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.471349    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy"
Sep 08 15:10:05.471523 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.471475    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy"
Sep 08 15:10:05.474290 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.474272    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.476784 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.476761    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-cc8fbdcf\""
Sep 08 15:10:05.476885 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.476865    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-cc8fbdcf-dockercfg-7fnx6\""
Sep 08 15:10:05.482358 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.482334    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"]
Sep 08 15:10:05.559850 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.559763    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2k7f\" (UniqueName: \"kubernetes.io/projected/3a81d85e-c532-498a-9b14-0bcbe0836e01-kube-api-access-h2k7f\") pod \"payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.560010 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.559864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a81d85e-c532-498a-9b14-0bcbe0836e01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.660610 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.660574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2k7f\" (UniqueName: \"kubernetes.io/projected/3a81d85e-c532-498a-9b14-0bcbe0836e01-kube-api-access-h2k7f\") pod \"payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.660755 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.660641    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a81d85e-c532-498a-9b14-0bcbe0836e01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.661287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.661268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a81d85e-c532-498a-9b14-0bcbe0836e01-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.667968 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.667945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2k7f\" (UniqueName: \"kubernetes.io/projected/3a81d85e-c532-498a-9b14-0bcbe0836e01-kube-api-access-h2k7f\") pod \"payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:05.785767 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:05.785730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:06.061618 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.061586    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"]
Sep 08 15:10:06.063075 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:10:06.063042    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a81d85e_c532_498a_9b14_0bcbe0836e01.slice/crio-6aa2de506bff033341db557835b96b6b106a6ec4908ccce15ed3fd512b8c97da WatchSource:0}: Error finding container 6aa2de506bff033341db557835b96b6b106a6ec4908ccce15ed3fd512b8c97da: Status 404 returned error can't find the container with id 6aa2de506bff033341db557835b96b6b106a6ec4908ccce15ed3fd512b8c97da
Sep 08 15:10:06.291538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.291501    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8" event={"ID":"e3b16ff2-0a7d-49b8-b4f5-10c53763f211","Type":"ContainerStarted","Data":"a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac"}
Sep 08 15:10:06.291726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.291565    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8" event={"ID":"e3b16ff2-0a7d-49b8-b4f5-10c53763f211","Type":"ContainerStarted","Data":"34526ee61fba117faadc64b8e4d8ed938ecdff4576325293d60b9b9b1992ac7a"}
Sep 08 15:10:06.291726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.291670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:06.293216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.293187    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p" event={"ID":"3a81d85e-c532-498a-9b14-0bcbe0836e01","Type":"ContainerStarted","Data":"83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd"}
Sep 08 15:10:06.293345 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.293240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:06.293345 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.293262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p" event={"ID":"3a81d85e-c532-498a-9b14-0bcbe0836e01","Type":"ContainerStarted","Data":"6aa2de506bff033341db557835b96b6b106a6ec4908ccce15ed3fd512b8c97da"}
Sep 08 15:10:06.311403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.311359    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8" podStartSLOduration=1.758818014 podStartE2EDuration="2.311348039s" totalImagesPullingTime="552.530025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:10:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:06.309553474 +0000 UTC m=+897.456574382" watchObservedRunningTime="2026-09-08 15:10:06.311348039 +0000 UTC m=+897.458368946"
Sep 08 15:10:06.328870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:06.328825    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p" podStartSLOduration=1.328813116 podStartE2EDuration="1.328813116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:06.326864227 +0000 UTC m=+897.473885126" watchObservedRunningTime="2026-09-08 15:10:06.328813116 +0000 UTC m=+897.475834035"
Sep 08 15:10:09.300857 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:09.300829    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:10:09.305427 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:09.305403    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:10:09.305848 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:09.305826    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:10:09.310712 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:09.310694    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:10:12.306117 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:12.306089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:17.302683 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:17.302642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:19.312635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:19.312597    2579 patch_prober.go:28] interesting pod/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:10:19.313112 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:19.312655    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:10:21.404154 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:21.404120    2579 generic.go:356] "Generic (PLEG): container finished" podID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerID="858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437" exitCode=0
Sep 08 15:10:21.404676 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:21.404195    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" event={"ID":"a90817d9-4b8c-4a9d-8287-c37cc14f66ef","Type":"ContainerDied","Data":"858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"}
Sep 08 15:10:21.404757 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:21.404676    2579 scope.go:117] "RemoveContainer" containerID="858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"
Sep 08 15:10:21.405822 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:21.405791    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:21.405904 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:21.405868    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:21.405943 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:21.405904    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:22.412044 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:22.412011    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" event={"ID":"a90817d9-4b8c-4a9d-8287-c37cc14f66ef","Type":"ContainerStarted","Data":"1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163"}
Sep 08 15:10:22.972408 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:22.972366    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:22.972594 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:22.972569    2579 patch_prober.go:28] interesting pod/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:10:22.972643 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:22.972620    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 08 15:10:23.972313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:23.972273    2579 patch_prober.go:28] interesting pod/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:10:23.972813 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:23.972339    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 08 15:10:24.972757 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:24.972713    2579 patch_prober.go:28] interesting pod/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:10:24.973164 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:24.972779    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 08 15:10:25.972676 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:25.972628    2579 patch_prober.go:28] interesting pod/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:10:25.972883 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:25.972699    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 08 15:10:26.972706 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:26.972665    2579 patch_prober.go:28] interesting pod/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 08 15:10:26.972916 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:26.972733    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 08 15:10:27.975883 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:27.975852    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:27.976327 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:27.976271    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:27.976899 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:27.976878    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:35.437352 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.437317    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"]
Sep 08 15:10:35.438103 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.438071    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8" podUID="e3b16ff2-0a7d-49b8-b4f5-10c53763f211" containerName="maas-api" containerID="cri-o://a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac" gracePeriod=30
Sep 08 15:10:35.494407 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.494365    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"]
Sep 08 15:10:35.494654 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.494625    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p" podUID="3a81d85e-c532-498a-9b14-0bcbe0836e01" containerName="payload-pre-processing" containerID="cri-o://83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd" gracePeriod=30
Sep 08 15:10:35.778486 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.778427    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:35.782032 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.782007    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:35.954260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954224    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-openshift-service-ca\") pod \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") "
Sep 08 15:10:35.954442 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-metrics-certs\") pod \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") "
Sep 08 15:10:35.954442 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954310    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg8xq\" (UniqueName: \"kubernetes.io/projected/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-kube-api-access-gg8xq\") pod \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") "
Sep 08 15:10:35.954442 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954382    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-maas-api-tls\") pod \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\" (UID: \"e3b16ff2-0a7d-49b8-b4f5-10c53763f211\") "
Sep 08 15:10:35.954650 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954478    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a81d85e-c532-498a-9b14-0bcbe0836e01-plugins-config-volume\") pod \"3a81d85e-c532-498a-9b14-0bcbe0836e01\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") "
Sep 08 15:10:35.954650 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2k7f\" (UniqueName: \"kubernetes.io/projected/3a81d85e-c532-498a-9b14-0bcbe0836e01-kube-api-access-h2k7f\") pod \"3a81d85e-c532-498a-9b14-0bcbe0836e01\" (UID: \"3a81d85e-c532-498a-9b14-0bcbe0836e01\") "
Sep 08 15:10:35.954753 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e3b16ff2-0a7d-49b8-b4f5-10c53763f211" (UID: "e3b16ff2-0a7d-49b8-b4f5-10c53763f211"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:35.954955 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.954925    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a81d85e-c532-498a-9b14-0bcbe0836e01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a81d85e-c532-498a-9b14-0bcbe0836e01" (UID: "3a81d85e-c532-498a-9b14-0bcbe0836e01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:35.955055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.955010    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:35.955055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.955029    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a81d85e-c532-498a-9b14-0bcbe0836e01-plugins-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:35.956672 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.956641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e3b16ff2-0a7d-49b8-b4f5-10c53763f211" (UID: "e3b16ff2-0a7d-49b8-b4f5-10c53763f211"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:10:35.956870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.956848    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a81d85e-c532-498a-9b14-0bcbe0836e01-kube-api-access-h2k7f" (OuterVolumeSpecName: "kube-api-access-h2k7f") pod "3a81d85e-c532-498a-9b14-0bcbe0836e01" (UID: "3a81d85e-c532-498a-9b14-0bcbe0836e01"). InnerVolumeSpecName "kube-api-access-h2k7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:35.956954 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.956937    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-kube-api-access-gg8xq" (OuterVolumeSpecName: "kube-api-access-gg8xq") pod "e3b16ff2-0a7d-49b8-b4f5-10c53763f211" (UID: "e3b16ff2-0a7d-49b8-b4f5-10c53763f211"). InnerVolumeSpecName "kube-api-access-gg8xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:35.956954 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:35.956943    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e3b16ff2-0a7d-49b8-b4f5-10c53763f211" (UID: "e3b16ff2-0a7d-49b8-b4f5-10c53763f211"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:10:36.056419 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.056363    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:36.056419 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.056387    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2k7f\" (UniqueName: \"kubernetes.io/projected/3a81d85e-c532-498a-9b14-0bcbe0836e01-kube-api-access-h2k7f\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:36.056419 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.056397    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:36.056419 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.056406    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg8xq\" (UniqueName: \"kubernetes.io/projected/e3b16ff2-0a7d-49b8-b4f5-10c53763f211-kube-api-access-gg8xq\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:36.500431 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.500401    2579 generic.go:356] "Generic (PLEG): container finished" podID="e3b16ff2-0a7d-49b8-b4f5-10c53763f211" containerID="a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac" exitCode=0
Sep 08 15:10:36.500842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.500465    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"
Sep 08 15:10:36.500842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.500488    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8" event={"ID":"e3b16ff2-0a7d-49b8-b4f5-10c53763f211","Type":"ContainerDied","Data":"a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac"}
Sep 08 15:10:36.500842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.500535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8" event={"ID":"e3b16ff2-0a7d-49b8-b4f5-10c53763f211","Type":"ContainerDied","Data":"34526ee61fba117faadc64b8e4d8ed938ecdff4576325293d60b9b9b1992ac7a"}
Sep 08 15:10:36.500842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.500561    2579 scope.go:117] "RemoveContainer" containerID="a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac"
Sep 08 15:10:36.501886 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.501841    2579 generic.go:356] "Generic (PLEG): container finished" podID="3a81d85e-c532-498a-9b14-0bcbe0836e01" containerID="83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd" exitCode=0
Sep 08 15:10:36.501960 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.501885    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"
Sep 08 15:10:36.501960 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.501889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p" event={"ID":"3a81d85e-c532-498a-9b14-0bcbe0836e01","Type":"ContainerDied","Data":"83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd"}
Sep 08 15:10:36.502083 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.501984    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p" event={"ID":"3a81d85e-c532-498a-9b14-0bcbe0836e01","Type":"ContainerDied","Data":"6aa2de506bff033341db557835b96b6b106a6ec4908ccce15ed3fd512b8c97da"}
Sep 08 15:10:36.510207 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.510191    2579 scope.go:117] "RemoveContainer" containerID="a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac"
Sep 08 15:10:36.510513 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:36.510486    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac\": container with ID starting with a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac not found: ID does not exist" containerID="a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac"
Sep 08 15:10:36.510619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.510520    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac"} err="failed to get container status \"a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac\": rpc error: code = NotFound desc = could not find container \"a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac\": container with ID starting with a5481a50bd73bb0abdde4faf383a78719b968c25a355476e0403dbe5e19303ac not found: ID does not exist"
Sep 08 15:10:36.510619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.510537    2579 scope.go:117] "RemoveContainer" containerID="83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd"
Sep 08 15:10:36.519151 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.519136    2579 scope.go:117] "RemoveContainer" containerID="83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd"
Sep 08 15:10:36.519490 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:36.519472    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd\": container with ID starting with 83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd not found: ID does not exist" containerID="83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd"
Sep 08 15:10:36.519537 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.519497    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd"} err="failed to get container status \"83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd\": rpc error: code = NotFound desc = could not find container \"83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd\": container with ID starting with 83c8ab0cea0eb62311b3c1d4ff632789693504a583f0d8b8fe6b044cf88f70bd not found: ID does not exist"
Sep 08 15:10:36.533420 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.533401    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"]
Sep 08 15:10:36.538668 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.538648    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-cc8fbdcf-75c9df48fd-sdb6p"]
Sep 08 15:10:36.548022 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.548002    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"]
Sep 08 15:10:36.552425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.552404    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cc8fbdcf-5b9cf7dd6d-t9cm8"]
Sep 08 15:10:36.789553 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.789482    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"]
Sep 08 15:10:36.789708 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:36.789675    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy" containerID="cri-o://1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163" gracePeriod=30
Sep 08 15:10:37.388642 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.388611    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a81d85e-c532-498a-9b14-0bcbe0836e01" path="/var/lib/kubelet/pods/3a81d85e-c532-498a-9b14-0bcbe0836e01/volumes"
Sep 08 15:10:37.389002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.388989    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b16ff2-0a7d-49b8-b4f5-10c53763f211" path="/var/lib/kubelet/pods/e3b16ff2-0a7d-49b8-b4f5-10c53763f211/volumes"
Sep 08 15:10:37.565856 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.565827    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"]
Sep 08 15:10:37.566249 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566236    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3b16ff2-0a7d-49b8-b4f5-10c53763f211" containerName="maas-api"
Sep 08 15:10:37.566249 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566250    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3b16ff2-0a7d-49b8-b4f5-10c53763f211" containerName="maas-api"
Sep 08 15:10:37.566342 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566264    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a81d85e-c532-498a-9b14-0bcbe0836e01" containerName="payload-pre-processing"
Sep 08 15:10:37.566342 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566270    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a81d85e-c532-498a-9b14-0bcbe0836e01" containerName="payload-pre-processing"
Sep 08 15:10:37.566421 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566344    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbb3acf1-0dec-40bd-b785-02aa0c53a7e5" containerName="istio-proxy"
Sep 08 15:10:37.566421 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566352    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3b16ff2-0a7d-49b8-b4f5-10c53763f211" containerName="maas-api"
Sep 08 15:10:37.566421 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.566359    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a81d85e-c532-498a-9b14-0bcbe0836e01" containerName="payload-pre-processing"
Sep 08 15:10:37.570195 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.570174    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.572733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.572714    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-9b84af36-openshift-default-dockercfg-26bjp\""
Sep 08 15:10:37.585438 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.585415    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"]
Sep 08 15:10:37.672085 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-socket\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672091    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5wsr\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-kube-api-access-b5wsr\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-certs\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980541e1-172f-4a8c-8a21-71bebf961a90-istio-podinfo\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672217    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-envoy\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980541e1-172f-4a8c-8a21-71bebf961a90-istiod-ca-cert\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672550 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-istio-token\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672550 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672320    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-data\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.672550 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.672423    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-credential-socket\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773179 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-credential-socket\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773360 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773196    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-socket\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773360 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5wsr\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-kube-api-access-b5wsr\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773360 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773267    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-certs\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773360 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980541e1-172f-4a8c-8a21-71bebf961a90-istio-podinfo\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773360 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-envoy\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980541e1-172f-4a8c-8a21-71bebf961a90-istiod-ca-cert\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-istio-token\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-data\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-credential-socket\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773684 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773661    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-certs\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773878 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773809    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-data\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.773878 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.773853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-socket\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.774267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.774247    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980541e1-172f-4a8c-8a21-71bebf961a90-istiod-ca-cert\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.775670 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.775646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-envoy\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.775921 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.775904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980541e1-172f-4a8c-8a21-71bebf961a90-istio-podinfo\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.785033 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.785010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5wsr\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-kube-api-access-b5wsr\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.785154 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.785089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-istio-token\") pod \"e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") " pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:37.880546 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:37.880514    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:38.175904 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.175875    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"]
Sep 08 15:10:38.177908 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:10:38.177882    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod980541e1_172f_4a8c_8a21_71bebf961a90.slice/crio-fdb55acc0852b7015a3c8d861f6bad3d297b798a0e72ef8e014bd92abf86a7bb WatchSource:0}: Error finding container fdb55acc0852b7015a3c8d861f6bad3d297b798a0e72ef8e014bd92abf86a7bb: Status 404 returned error can't find the container with id fdb55acc0852b7015a3c8d861f6bad3d297b798a0e72ef8e014bd92abf86a7bb
Sep 08 15:10:38.180280 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.180215    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:38.180376 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.180280    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:38.180376 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.180310    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:10:38.518093 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.518007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" event={"ID":"980541e1-172f-4a8c-8a21-71bebf961a90","Type":"ContainerStarted","Data":"5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"}
Sep 08 15:10:38.518093 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.518068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" event={"ID":"980541e1-172f-4a8c-8a21-71bebf961a90","Type":"ContainerStarted","Data":"fdb55acc0852b7015a3c8d861f6bad3d297b798a0e72ef8e014bd92abf86a7bb"}
Sep 08 15:10:38.538860 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.538803    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podStartSLOduration=1.538772537 podStartE2EDuration="1.538772537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:10:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:38.538010529 +0000 UTC m=+929.685031469" watchObservedRunningTime="2026-09-08 15:10:38.538772537 +0000 UTC m=+929.685793465"
Sep 08 15:10:38.880973 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:38.880899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:39.886953 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:39.886916    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:40.529791 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:40.529761    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:40.530565 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:40.530545    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:10:41.031460 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.031412    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"]
Sep 08 15:10:41.034521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.034494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.036952 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.036926    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9b84af36-serving-cert\""
Sep 08 15:10:41.047767 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.047737    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"]
Sep 08 15:10:41.100683 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.100652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-maas-api-tls\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.100825 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.100714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-metrics-certs\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.100825 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.100796    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98q9j\" (UniqueName: \"kubernetes.io/projected/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-kube-api-access-98q9j\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.100916 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.100848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-openshift-service-ca\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.201465 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.201418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98q9j\" (UniqueName: \"kubernetes.io/projected/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-kube-api-access-98q9j\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.201643 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.201502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-openshift-service-ca\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.201643 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.201559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-maas-api-tls\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.201643 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.201600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-metrics-certs\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.202231 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.202204    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-openshift-service-ca\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.204022 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.204000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-maas-api-tls\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.204135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.204036    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-metrics-certs\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.209889 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.209866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98q9j\" (UniqueName: \"kubernetes.io/projected/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-kube-api-access-98q9j\") pod \"maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.347655 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.347586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:41.627924 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.625810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"]
Sep 08 15:10:41.628178 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:10:41.628147    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d25ca0_82e7_435b_aee8_f407aa1cee9e.slice/crio-684c684545ff58a53fb23a3a6acd1a8d64f9f59b21625b81e28a50b982a8c55e WatchSource:0}: Error finding container 684c684545ff58a53fb23a3a6acd1a8d64f9f59b21625b81e28a50b982a8c55e: Status 404 returned error can't find the container with id 684c684545ff58a53fb23a3a6acd1a8d64f9f59b21625b81e28a50b982a8c55e
Sep 08 15:10:41.630171 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:41.630145    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:10:42.033546 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.033512    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:42.110383 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110360    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-socket\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110492 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110416    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-token\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110492 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110442    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-certs\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110650 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110628    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istiod-ca-cert\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110714 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110673    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-credential-socket\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110714 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110683    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:42.110825 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110751    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-envoy\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110825 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110769    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:42.110825 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110779    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p526j\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-kube-api-access-p526j\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.110825 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110810    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-data\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.111037 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110858    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-podinfo\") pod \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\" (UID: \"a90817d9-4b8c-4a9d-8287-c37cc14f66ef\") "
Sep 08 15:10:42.111037 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.110993    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:42.111037 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.111009    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:42.111260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.111237    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.111385 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.111264    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.111385 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.111278    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.111385 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.111290    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.111862 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.111835    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-data" (OuterVolumeSpecName: "istio-data") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:42.112917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.112883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:42.113013 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.112915    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:10:42.113141 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.113120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:10:42.113880 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.113859    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-kube-api-access-p526j" (OuterVolumeSpecName: "kube-api-access-p526j") pod "a90817d9-4b8c-4a9d-8287-c37cc14f66ef" (UID: "a90817d9-4b8c-4a9d-8287-c37cc14f66ef"). InnerVolumeSpecName "kube-api-access-p526j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:42.212838 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.212810    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p526j\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-kube-api-access-p526j\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.212959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.212843    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.212959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.212856    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.212959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.212867    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.212959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.212879    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a90817d9-4b8c-4a9d-8287-c37cc14f66ef-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:42.544274 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.544200    2579 generic.go:356] "Generic (PLEG): container finished" podID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerID="1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163" exitCode=0
Sep 08 15:10:42.544274 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.544250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"
Sep 08 15:10:42.544528 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.544280    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" event={"ID":"a90817d9-4b8c-4a9d-8287-c37cc14f66ef","Type":"ContainerDied","Data":"1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163"}
Sep 08 15:10:42.544528 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.544336    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p" event={"ID":"a90817d9-4b8c-4a9d-8287-c37cc14f66ef","Type":"ContainerDied","Data":"cbea23680cd29911239066205b1bcef6d7926771188f641f3b7b8ee4e1308a3c"}
Sep 08 15:10:42.544528 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.544366    2579 scope.go:117] "RemoveContainer" containerID="1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163"
Sep 08 15:10:42.546522 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.546486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t" event={"ID":"e5d25ca0-82e7-435b-aee8-f407aa1cee9e","Type":"ContainerStarted","Data":"82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f"}
Sep 08 15:10:42.546667 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.546555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t" event={"ID":"e5d25ca0-82e7-435b-aee8-f407aa1cee9e","Type":"ContainerStarted","Data":"684c684545ff58a53fb23a3a6acd1a8d64f9f59b21625b81e28a50b982a8c55e"}
Sep 08 15:10:42.546783 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.546755    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:42.559115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.556555    2579 scope.go:117] "RemoveContainer" containerID="858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"
Sep 08 15:10:42.568592 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.568575    2579 scope.go:117] "RemoveContainer" containerID="1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163"
Sep 08 15:10:42.568889 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:42.568861    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163\": container with ID starting with 1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163 not found: ID does not exist" containerID="1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163"
Sep 08 15:10:42.568949 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.568906    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163"} err="failed to get container status \"1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163\": rpc error: code = NotFound desc = could not find container \"1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163\": container with ID starting with 1302a942a3bb0a99c26e1533bb353849c9c597abd0976e7b32ccbf8bab79a163 not found: ID does not exist"
Sep 08 15:10:42.568949 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.568932    2579 scope.go:117] "RemoveContainer" containerID="858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"
Sep 08 15:10:42.569339 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:10:42.569284    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437\": container with ID starting with 858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437 not found: ID does not exist" containerID="858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"
Sep 08 15:10:42.569339 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.569321    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437"} err="failed to get container status \"858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437\": rpc error: code = NotFound desc = could not find container \"858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437\": container with ID starting with 858450f76daf83722870b0e114b1c2c3c5d31fc26dcf672e5b10da01ba4e8437 not found: ID does not exist"
Sep 08 15:10:42.572538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.572501    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t" podStartSLOduration=1.14768234 podStartE2EDuration="1.572488653s" totalImagesPullingTime="424.806313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:10:42.569229176 +0000 UTC m=+933.716250085" watchObservedRunningTime="2026-09-08 15:10:42.572488653 +0000 UTC m=+933.719509561"
Sep 08 15:10:42.584947 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.584927    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"]
Sep 08 15:10:42.588999 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:42.588978    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cc8fbdcf-openshift-default-597c95df46-txf4p"]
Sep 08 15:10:43.389284 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:43.389248    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" path="/var/lib/kubelet/pods/a90817d9-4b8c-4a9d-8287-c37cc14f66ef/volumes"
Sep 08 15:10:48.559595 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:48.559567    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:10:55.495855 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.495820    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"]
Sep 08 15:10:55.496467 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.496025    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv" podUID="428f6407-3bf9-4d41-bb59-ed34449a90fa" containerName="payload-pre-processing" containerID="cri-o://c97f0c741c26a9bbb18f433cb8a6373f75d0164a5a8f69d37eead26c3dc239ba" gracePeriod=30
Sep 08 15:10:55.628818 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.628786    2579 generic.go:356] "Generic (PLEG): container finished" podID="428f6407-3bf9-4d41-bb59-ed34449a90fa" containerID="c97f0c741c26a9bbb18f433cb8a6373f75d0164a5a8f69d37eead26c3dc239ba" exitCode=0
Sep 08 15:10:55.628947 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.628854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv" event={"ID":"428f6407-3bf9-4d41-bb59-ed34449a90fa","Type":"ContainerDied","Data":"c97f0c741c26a9bbb18f433cb8a6373f75d0164a5a8f69d37eead26c3dc239ba"}
Sep 08 15:10:55.797990 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.797964    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:10:55.836333 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.836292    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/428f6407-3bf9-4d41-bb59-ed34449a90fa-plugins-config-volume\") pod \"428f6407-3bf9-4d41-bb59-ed34449a90fa\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") "
Sep 08 15:10:55.836513 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.836359    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ld42\" (UniqueName: \"kubernetes.io/projected/428f6407-3bf9-4d41-bb59-ed34449a90fa-kube-api-access-6ld42\") pod \"428f6407-3bf9-4d41-bb59-ed34449a90fa\" (UID: \"428f6407-3bf9-4d41-bb59-ed34449a90fa\") "
Sep 08 15:10:55.836781 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.836756    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/428f6407-3bf9-4d41-bb59-ed34449a90fa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "428f6407-3bf9-4d41-bb59-ed34449a90fa" (UID: "428f6407-3bf9-4d41-bb59-ed34449a90fa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:10:55.839590 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.839565    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428f6407-3bf9-4d41-bb59-ed34449a90fa-kube-api-access-6ld42" (OuterVolumeSpecName: "kube-api-access-6ld42") pod "428f6407-3bf9-4d41-bb59-ed34449a90fa" (UID: "428f6407-3bf9-4d41-bb59-ed34449a90fa"). InnerVolumeSpecName "kube-api-access-6ld42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:10:55.937956 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.937923    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/428f6407-3bf9-4d41-bb59-ed34449a90fa-plugins-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:55.937956 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:55.937952    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ld42\" (UniqueName: \"kubernetes.io/projected/428f6407-3bf9-4d41-bb59-ed34449a90fa-kube-api-access-6ld42\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:10:56.636433 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:56.636403    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"
Sep 08 15:10:56.636433 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:56.636413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv" event={"ID":"428f6407-3bf9-4d41-bb59-ed34449a90fa","Type":"ContainerDied","Data":"c2f91a5073a0fc52a8034742f98b71a155c0cf4611275c89c3fc673975947831"}
Sep 08 15:10:56.636926 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:56.636482    2579 scope.go:117] "RemoveContainer" containerID="c97f0c741c26a9bbb18f433cb8a6373f75d0164a5a8f69d37eead26c3dc239ba"
Sep 08 15:10:56.671740 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:56.671687    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"]
Sep 08 15:10:56.675956 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:56.675927    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-6b2b2e-84ccf8b7d-nq2tv"]
Sep 08 15:10:57.388602 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:10:57.388572    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="428f6407-3bf9-4d41-bb59-ed34449a90fa" path="/var/lib/kubelet/pods/428f6407-3bf9-4d41-bb59-ed34449a90fa/volumes"
Sep 08 15:11:04.709557 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:04.709523    2579 generic.go:356] "Generic (PLEG): container finished" podID="980541e1-172f-4a8c-8a21-71bebf961a90" containerID="5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b" exitCode=0
Sep 08 15:11:04.709958 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:04.709597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" event={"ID":"980541e1-172f-4a8c-8a21-71bebf961a90","Type":"ContainerDied","Data":"5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"}
Sep 08 15:11:04.710001 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:04.709963    2579 scope.go:117] "RemoveContainer" containerID="5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"
Sep 08 15:11:04.711039 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:04.711009    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:04.711106 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:04.711089    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:04.711144 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:04.711133    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:05.717986 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:05.717951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" event={"ID":"980541e1-172f-4a8c-8a21-71bebf961a90","Type":"ContainerStarted","Data":"2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663"}
Sep 08 15:11:05.881529 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:05.881490    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:11:05.882540 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:05.882514    2579 patch_prober.go:28] interesting pod/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:11:05.882610 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:05.882568    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 15:11:06.880913 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:06.880880    2579 patch_prober.go:28] interesting pod/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:11:06.881265 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:06.880944    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 15:11:07.881571 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:07.881538    2579 patch_prober.go:28] interesting pod/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:11:07.881942 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:07.881595    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 15:11:08.881157 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:08.881119    2579 patch_prober.go:28] interesting pod/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:11:08.881325 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:08.881178    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 15:11:09.881041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:09.881002    2579 patch_prober.go:28] interesting pod/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 15:11:09.881421 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:09.881069    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 15:11:10.530640 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:10.530599    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:11:10.938345 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:10.938305    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:11:10.940505 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:10.940481    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:11:11.673397 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:11.673361    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"]
Sep 08 15:11:11.673664 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:11.673616    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t" podUID="e5d25ca0-82e7-435b-aee8-f407aa1cee9e" containerName="maas-api" containerID="cri-o://82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f" gracePeriod=30
Sep 08 15:11:11.920687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:11.920663    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:11:12.050031 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.049938    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"]
Sep 08 15:11:12.095947 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.095920    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-maas-api-tls\") pod \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") "
Sep 08 15:11:12.096087 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.096010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-openshift-service-ca\") pod \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") "
Sep 08 15:11:12.096087 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.096047    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98q9j\" (UniqueName: \"kubernetes.io/projected/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-kube-api-access-98q9j\") pod \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") "
Sep 08 15:11:12.096087 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.096078    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-metrics-certs\") pod \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\" (UID: \"e5d25ca0-82e7-435b-aee8-f407aa1cee9e\") "
Sep 08 15:11:12.096375 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.096350    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5d25ca0-82e7-435b-aee8-f407aa1cee9e" (UID: "e5d25ca0-82e7-435b-aee8-f407aa1cee9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:11:12.098040 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.098015    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5d25ca0-82e7-435b-aee8-f407aa1cee9e" (UID: "e5d25ca0-82e7-435b-aee8-f407aa1cee9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:11:12.098144 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.098060    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-kube-api-access-98q9j" (OuterVolumeSpecName: "kube-api-access-98q9j") pod "e5d25ca0-82e7-435b-aee8-f407aa1cee9e" (UID: "e5d25ca0-82e7-435b-aee8-f407aa1cee9e"). InnerVolumeSpecName "kube-api-access-98q9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:11:12.098144 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.098076    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e5d25ca0-82e7-435b-aee8-f407aa1cee9e" (UID: "e5d25ca0-82e7-435b-aee8-f407aa1cee9e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:11:12.197420 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.197373    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98q9j\" (UniqueName: \"kubernetes.io/projected/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-kube-api-access-98q9j\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:12.197420 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.197414    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:12.197420 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.197424    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:12.197420 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.197432    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5d25ca0-82e7-435b-aee8-f407aa1cee9e-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:12.766119 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.766089    2579 generic.go:356] "Generic (PLEG): container finished" podID="e5d25ca0-82e7-435b-aee8-f407aa1cee9e" containerID="82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f" exitCode=0
Sep 08 15:11:12.766288 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.766135    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"
Sep 08 15:11:12.766288 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.766188    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t" event={"ID":"e5d25ca0-82e7-435b-aee8-f407aa1cee9e","Type":"ContainerDied","Data":"82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f"}
Sep 08 15:11:12.766288 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.766249    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t" event={"ID":"e5d25ca0-82e7-435b-aee8-f407aa1cee9e","Type":"ContainerDied","Data":"684c684545ff58a53fb23a3a6acd1a8d64f9f59b21625b81e28a50b982a8c55e"}
Sep 08 15:11:12.766288 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.766279    2579 scope.go:117] "RemoveContainer" containerID="82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f"
Sep 08 15:11:12.766495 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.766346    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy" containerID="cri-o://2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663" gracePeriod=30
Sep 08 15:11:12.776362 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.776344    2579 scope.go:117] "RemoveContainer" containerID="82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f"
Sep 08 15:11:12.776653 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:11:12.776637    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f\": container with ID starting with 82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f not found: ID does not exist" containerID="82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f"
Sep 08 15:11:12.776710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.776663    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f"} err="failed to get container status \"82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f\": rpc error: code = NotFound desc = could not find container \"82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f\": container with ID starting with 82fc7e886252330c646d3ddfe65ffda1893bf879ee00fc1939b5bc377d1d9f1f not found: ID does not exist"
Sep 08 15:11:12.801704 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.801678    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"]
Sep 08 15:11:12.809614 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:12.809593    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9b84af36-77f54bdd47-fsd8t"]
Sep 08 15:11:13.388263 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:13.388229    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5d25ca0-82e7-435b-aee8-f407aa1cee9e" path="/var/lib/kubelet/pods/e5d25ca0-82e7-435b-aee8-f407aa1cee9e/volumes"
Sep 08 15:11:18.022185 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.022164    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:11:18.148453 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148424    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980541e1-172f-4a8c-8a21-71bebf961a90-istio-podinfo\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148486    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5wsr\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-kube-api-access-b5wsr\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148520    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-istio-token\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-socket\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-certs\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148609    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-data\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148900 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980541e1-172f-4a8c-8a21-71bebf961a90-istiod-ca-cert\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148900 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148750    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-envoy\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.148900 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148789    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-credential-socket\") pod \"980541e1-172f-4a8c-8a21-71bebf961a90\" (UID: \"980541e1-172f-4a8c-8a21-71bebf961a90\") "
Sep 08 15:11:18.149054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148926    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:18.149054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148957    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-data" (OuterVolumeSpecName: "istio-data") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:18.149054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.148967    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:18.149216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.149132    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:18.149216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.149142    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.149216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.149162    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.149216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.149174    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.149502 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.149467    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/980541e1-172f-4a8c-8a21-71bebf961a90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:11:18.150880 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.150858    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-istio-token" (OuterVolumeSpecName: "istio-token") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:11:18.150992 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.150882    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-kube-api-access-b5wsr" (OuterVolumeSpecName: "kube-api-access-b5wsr") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "kube-api-access-b5wsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:11:18.151093 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.151076    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/980541e1-172f-4a8c-8a21-71bebf961a90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:11:18.151156 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.151141    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "980541e1-172f-4a8c-8a21-71bebf961a90" (UID: "980541e1-172f-4a8c-8a21-71bebf961a90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:11:18.249651 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.249624    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/980541e1-172f-4a8c-8a21-71bebf961a90-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.249651 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.249650    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.249827 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.249659    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/980541e1-172f-4a8c-8a21-71bebf961a90-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.249827 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.249674    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/980541e1-172f-4a8c-8a21-71bebf961a90-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.249827 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.249687    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5wsr\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-kube-api-access-b5wsr\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.249827 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.249696    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/980541e1-172f-4a8c-8a21-71bebf961a90-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:11:18.802949 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.802918    2579 generic.go:356] "Generic (PLEG): container finished" podID="980541e1-172f-4a8c-8a21-71bebf961a90" containerID="2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663" exitCode=0
Sep 08 15:11:18.803135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.802971    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"
Sep 08 15:11:18.803135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.803006    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" event={"ID":"980541e1-172f-4a8c-8a21-71bebf961a90","Type":"ContainerDied","Data":"2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663"}
Sep 08 15:11:18.803135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.803060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6" event={"ID":"980541e1-172f-4a8c-8a21-71bebf961a90","Type":"ContainerDied","Data":"fdb55acc0852b7015a3c8d861f6bad3d297b798a0e72ef8e014bd92abf86a7bb"}
Sep 08 15:11:18.803135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.803084    2579 scope.go:117] "RemoveContainer" containerID="2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663"
Sep 08 15:11:18.812984 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.812970    2579 scope.go:117] "RemoveContainer" containerID="5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"
Sep 08 15:11:18.821329 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.821312    2579 scope.go:117] "RemoveContainer" containerID="2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663"
Sep 08 15:11:18.821605 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:11:18.821584    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663\": container with ID starting with 2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663 not found: ID does not exist" containerID="2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663"
Sep 08 15:11:18.821656 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.821613    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663"} err="failed to get container status \"2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663\": rpc error: code = NotFound desc = could not find container \"2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663\": container with ID starting with 2cdcab1327b7d1501b5a66e115890b5c6395069b7eb3de3f69a5bc3654d12663 not found: ID does not exist"
Sep 08 15:11:18.821656 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.821629    2579 scope.go:117] "RemoveContainer" containerID="5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"
Sep 08 15:11:18.821884 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:11:18.821869    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b\": container with ID starting with 5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b not found: ID does not exist" containerID="5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"
Sep 08 15:11:18.821938 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.821886    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b"} err="failed to get container status \"5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b\": rpc error: code = NotFound desc = could not find container \"5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b\": container with ID starting with 5f87e4abc73ce9c259790a4b175e48bac5117f840fd7863ff43322f7bf9ca93b not found: ID does not exist"
Sep 08 15:11:18.825328 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.825307    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"]
Sep 08 15:11:18.829527 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:18.829507    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-9b84af36-openshift-default-5454d8d85b-rt5p6"]
Sep 08 15:11:19.389219 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:19.389186    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" path="/var/lib/kubelet/pods/980541e1-172f-4a8c-8a21-71bebf961a90/volumes"
Sep 08 15:11:34.532952 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.532881    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"]
Sep 08 15:11:34.533379 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533319    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy"
Sep 08 15:11:34.533379 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533332    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy"
Sep 08 15:11:34.533379 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533346    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428f6407-3bf9-4d41-bb59-ed34449a90fa" containerName="payload-pre-processing"
Sep 08 15:11:34.533379 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533352    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="428f6407-3bf9-4d41-bb59-ed34449a90fa" containerName="payload-pre-processing"
Sep 08 15:11:34.533379 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533359    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533365    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533414    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5d25ca0-82e7-435b-aee8-f407aa1cee9e" containerName="maas-api"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533420    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5d25ca0-82e7-435b-aee8-f407aa1cee9e" containerName="maas-api"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533501    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5d25ca0-82e7-435b-aee8-f407aa1cee9e" containerName="maas-api"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533508    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="428f6407-3bf9-4d41-bb59-ed34449a90fa" containerName="payload-pre-processing"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533516    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy"
Sep 08 15:11:34.533579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.533521    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy"
Sep 08 15:11:34.537943 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.537926    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.540578 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.540559    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-ac43b2-openshift-default-dockercfg-qvhfn\""
Sep 08 15:11:34.557842 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.557817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"]
Sep 08 15:11:34.570777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.570754    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-socket\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571045 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-podinfo\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571171 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571099    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-envoy\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571171 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571134    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-certs\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571294 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571201    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-credential-socket\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571496 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571442    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-token\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571555 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istiod-ca-cert\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571555 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571538    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24wsf\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-kube-api-access-24wsf\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.571633 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.571569    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-data\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.672721 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672690    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-token\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.672721 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istiod-ca-cert\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.672721 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672741    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24wsf\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-kube-api-access-24wsf\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.673238 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672767    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-data\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.673238 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-socket\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.673238 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672889    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-podinfo\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.673238 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-envoy\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.673740 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.672962    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-certs\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.673866 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.673835    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-credential-socket\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.674117 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.674094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-socket\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.674342 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.674318    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-data\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.674439 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.674415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-credential-socket\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.674782 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.674755    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istiod-ca-cert\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.674782 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.674774    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-certs\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.676805 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.676778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-podinfo\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.681470 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.677697    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-envoy\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.684787 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.684766    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-token\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.684911 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.684893    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24wsf\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-kube-api-access-24wsf\") pod \"e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") " pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:34.849113 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:34.849034    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:35.130305 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.130275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"]
Sep 08 15:11:35.130942 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:11:35.130913    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e15d5e_c4b7_4eba_bcd0_9f475228e5cc.slice/crio-16703c2d7b432bcdd80e32e2dda935069f651d689f83a8f201616b79b1a933ac WatchSource:0}: Error finding container 16703c2d7b432bcdd80e32e2dda935069f651d689f83a8f201616b79b1a933ac: Status 404 returned error can't find the container with id 16703c2d7b432bcdd80e32e2dda935069f651d689f83a8f201616b79b1a933ac
Sep 08 15:11:35.133173 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.133136    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:35.133264 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.133205    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:35.133264 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.133234    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:35.910243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.910201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" event={"ID":"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc","Type":"ContainerStarted","Data":"2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"}
Sep 08 15:11:35.910643 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.910269    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" event={"ID":"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc","Type":"ContainerStarted","Data":"16703c2d7b432bcdd80e32e2dda935069f651d689f83a8f201616b79b1a933ac"}
Sep 08 15:11:35.929824 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:35.929778    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podStartSLOduration=1.9297631 podStartE2EDuration="1.9297631s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:11:35.928088316 +0000 UTC m=+987.075109220" watchObservedRunningTime="2026-09-08 15:11:35.9297631 +0000 UTC m=+987.076784006"
Sep 08 15:11:36.850196 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:36.850156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:36.855861 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:36.855836    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:36.916385 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:36.916357    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:36.917237 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:36.917218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:39.010558 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.010529    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"]
Sep 08 15:11:39.010964 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.010950    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy"
Sep 08 15:11:39.011019 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.010966    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="980541e1-172f-4a8c-8a21-71bebf961a90" containerName="istio-proxy"
Sep 08 15:11:39.011019 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.010993    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy"
Sep 08 15:11:39.011019 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.010999    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy"
Sep 08 15:11:39.011111 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.011063    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90817d9-4b8c-4a9d-8287-c37cc14f66ef" containerName="istio-proxy"
Sep 08 15:11:39.014031 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.014010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.016260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.016238    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-ac43b2-serving-cert\""
Sep 08 15:11:39.029345 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.029321    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"]
Sep 08 15:11:39.113900 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.113863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-maas-api-tls\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.114054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.113911    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gv6t\" (UniqueName: \"kubernetes.io/projected/5f0a1459-3d85-40f0-a20b-919d752c666c-kube-api-access-6gv6t\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.114054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.113980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0a1459-3d85-40f0-a20b-919d752c666c-openshift-service-ca\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.114142 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.114062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-metrics-certs\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.214806 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.214769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0a1459-3d85-40f0-a20b-919d752c666c-openshift-service-ca\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.214979 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.214836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-metrics-certs\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.214979 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.214905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-maas-api-tls\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.214979 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.214933    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gv6t\" (UniqueName: \"kubernetes.io/projected/5f0a1459-3d85-40f0-a20b-919d752c666c-kube-api-access-6gv6t\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.215424 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.215393    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0a1459-3d85-40f0-a20b-919d752c666c-openshift-service-ca\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.217267 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.217242    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-maas-api-tls\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.217376 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.217360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-metrics-certs\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.223116 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.223092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gv6t\" (UniqueName: \"kubernetes.io/projected/5f0a1459-3d85-40f0-a20b-919d752c666c-kube-api-access-6gv6t\") pod \"maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.325602 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.325547    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:39.603740 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.603708    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"]
Sep 08 15:11:39.605052 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:11:39.605019    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0a1459_3d85_40f0_a20b_919d752c666c.slice/crio-272076e8eee5dca261421d8fa93c333dafd56b8a1c8b50ac5eafe359546c917f WatchSource:0}: Error finding container 272076e8eee5dca261421d8fa93c333dafd56b8a1c8b50ac5eafe359546c917f: Status 404 returned error can't find the container with id 272076e8eee5dca261421d8fa93c333dafd56b8a1c8b50ac5eafe359546c917f
Sep 08 15:11:39.934790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:39.934756    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl" event={"ID":"5f0a1459-3d85-40f0-a20b-919d752c666c","Type":"ContainerStarted","Data":"272076e8eee5dca261421d8fa93c333dafd56b8a1c8b50ac5eafe359546c917f"}
Sep 08 15:11:40.943118 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:40.943079    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl" event={"ID":"5f0a1459-3d85-40f0-a20b-919d752c666c","Type":"ContainerStarted","Data":"3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c"}
Sep 08 15:11:40.943623 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:40.943186    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:40.962141 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:40.962100    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl" podStartSLOduration=2.603014806 podStartE2EDuration="2.962087536s" totalImagesPullingTime="359.07273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:11:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:11:40.960415877 +0000 UTC m=+992.107436785" watchObservedRunningTime="2026-09-08 15:11:40.962087536 +0000 UTC m=+992.109108442"
Sep 08 15:11:46.963766 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:46.963723    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:11:52.957593 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:52.957560    2579 patch_prober.go:28] interesting pod/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:11:52.957991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:52.957628    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:11:54.030732 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:54.030694    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerID="2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2" exitCode=0
Sep 08 15:11:54.031247 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:54.030772    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" event={"ID":"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc","Type":"ContainerDied","Data":"2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"}
Sep 08 15:11:54.031343 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:54.031325    2579 scope.go:117] "RemoveContainer" containerID="2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"
Sep 08 15:11:54.032482 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:54.032432    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:54.032576 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:54.032522    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:54.032576 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:54.032569    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:11:55.038629 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:55.038593    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" event={"ID":"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc","Type":"ContainerStarted","Data":"63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc"}
Sep 08 15:11:55.850200 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:55.850156    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:11:55.850400 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:55.850286    2579 patch_prober.go:28] interesting pod/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:11:55.850400 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:55.850341    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 15:11:56.850322 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:56.850286    2579 patch_prober.go:28] interesting pod/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:11:56.850900 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:56.850860    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 15:11:57.849625 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:57.849584    2579 patch_prober.go:28] interesting pod/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:11:57.849830 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:57.849648    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 15:11:58.850125 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:58.850089    2579 patch_prober.go:28] interesting pod/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:11:58.850715 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:58.850684    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 15:11:59.849628 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:59.849583    2579 patch_prober.go:28] interesting pod/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 15:11:59.849835 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:11:59.849662    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 15:12:00.853673 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:00.853641    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:12:00.854087 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:00.854066    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:12:00.854819 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:00.854797    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:12:32.642321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.642288    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"]
Sep 08 15:12:32.642843 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.642558    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl" podUID="5f0a1459-3d85-40f0-a20b-919d752c666c" containerName="maas-api" containerID="cri-o://3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c" gracePeriod=30
Sep 08 15:12:32.904157 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.904102    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:12:32.999905 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.999872    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-metrics-certs\") pod \"5f0a1459-3d85-40f0-a20b-919d752c666c\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") "
Sep 08 15:12:33.000050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.999926    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-maas-api-tls\") pod \"5f0a1459-3d85-40f0-a20b-919d752c666c\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") "
Sep 08 15:12:33.000050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.999960    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0a1459-3d85-40f0-a20b-919d752c666c-openshift-service-ca\") pod \"5f0a1459-3d85-40f0-a20b-919d752c666c\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") "
Sep 08 15:12:33.000050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:32.999997    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gv6t\" (UniqueName: \"kubernetes.io/projected/5f0a1459-3d85-40f0-a20b-919d752c666c-kube-api-access-6gv6t\") pod \"5f0a1459-3d85-40f0-a20b-919d752c666c\" (UID: \"5f0a1459-3d85-40f0-a20b-919d752c666c\") "
Sep 08 15:12:33.000294 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.000269    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f0a1459-3d85-40f0-a20b-919d752c666c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f0a1459-3d85-40f0-a20b-919d752c666c" (UID: "5f0a1459-3d85-40f0-a20b-919d752c666c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:12:33.002279 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.002231    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f0a1459-3d85-40f0-a20b-919d752c666c" (UID: "5f0a1459-3d85-40f0-a20b-919d752c666c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:12:33.002380 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.002328    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f0a1459-3d85-40f0-a20b-919d752c666c-kube-api-access-6gv6t" (OuterVolumeSpecName: "kube-api-access-6gv6t") pod "5f0a1459-3d85-40f0-a20b-919d752c666c" (UID: "5f0a1459-3d85-40f0-a20b-919d752c666c"). InnerVolumeSpecName "kube-api-access-6gv6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:12:33.002438 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.002371    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5f0a1459-3d85-40f0-a20b-919d752c666c" (UID: "5f0a1459-3d85-40f0-a20b-919d752c666c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:12:33.101619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.101586    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:33.101619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.101612    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f0a1459-3d85-40f0-a20b-919d752c666c-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:33.101619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.101621    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f0a1459-3d85-40f0-a20b-919d752c666c-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:33.101817 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.101630    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gv6t\" (UniqueName: \"kubernetes.io/projected/5f0a1459-3d85-40f0-a20b-919d752c666c-kube-api-access-6gv6t\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:33.287518 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.287415    2579 generic.go:356] "Generic (PLEG): container finished" podID="5f0a1459-3d85-40f0-a20b-919d752c666c" containerID="3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c" exitCode=0
Sep 08 15:12:33.287518 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.287484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl" event={"ID":"5f0a1459-3d85-40f0-a20b-919d752c666c","Type":"ContainerDied","Data":"3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c"}
Sep 08 15:12:33.287705 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.287540    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl" event={"ID":"5f0a1459-3d85-40f0-a20b-919d752c666c","Type":"ContainerDied","Data":"272076e8eee5dca261421d8fa93c333dafd56b8a1c8b50ac5eafe359546c917f"}
Sep 08 15:12:33.287705 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.287561    2579 scope.go:117] "RemoveContainer" containerID="3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c"
Sep 08 15:12:33.287705 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.287499    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"
Sep 08 15:12:33.297513 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.297495    2579 scope.go:117] "RemoveContainer" containerID="3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c"
Sep 08 15:12:33.297771 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:12:33.297752    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c\": container with ID starting with 3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c not found: ID does not exist" containerID="3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c"
Sep 08 15:12:33.297819 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.297780    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c"} err="failed to get container status \"3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c\": rpc error: code = NotFound desc = could not find container \"3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c\": container with ID starting with 3d86bc7becf9ff89ed18793fe115e55348f77cfcd06b3693cde40fb5df114c9c not found: ID does not exist"
Sep 08 15:12:33.326361 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.326337    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"]
Sep 08 15:12:33.329733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.329711    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-ac43b2-5c7c77d9cb-mvwhl"]
Sep 08 15:12:33.390989 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:33.390962    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f0a1459-3d85-40f0-a20b-919d752c666c" path="/var/lib/kubelet/pods/5f0a1459-3d85-40f0-a20b-919d752c666c/volumes"
Sep 08 15:12:39.490119 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:39.490087    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"]
Sep 08 15:12:39.490612 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:39.490296    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy" containerID="cri-o://63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc" gracePeriod=30
Sep 08 15:12:40.324142 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.324109    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"]
Sep 08 15:12:40.324585 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.324571    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f0a1459-3d85-40f0-a20b-919d752c666c" containerName="maas-api"
Sep 08 15:12:40.324639 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.324587    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f0a1459-3d85-40f0-a20b-919d752c666c" containerName="maas-api"
Sep 08 15:12:40.324673 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.324668    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f0a1459-3d85-40f0-a20b-919d752c666c" containerName="maas-api"
Sep 08 15:12:40.328971 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.328939    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.332131 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.332106    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-e3e2a7-openshift-default-dockercfg-96s6t\""
Sep 08 15:12:40.342482 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.342434    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"]
Sep 08 15:12:40.367903 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.367864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-socket\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.367903 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.367901    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0586b3-cbc8-422a-a5b6-baa0af952891-istiod-ca-cert\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.367923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-podinfo\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.367959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-token\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.367976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-data\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.368001    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2t8t\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-kube-api-access-z2t8t\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.368038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-credential-socket\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.368056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-envoy\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.368108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.368093    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-certs\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.468871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.468841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-socket\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.468879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0586b3-cbc8-422a-a5b6-baa0af952891-istiod-ca-cert\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.468917    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-podinfo\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.468951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-token\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.468986    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-data\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2t8t\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-kube-api-access-z2t8t\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-credential-socket\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-envoy\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-certs\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469410    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-data\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469723 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-credential-socket\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469848 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0586b3-cbc8-422a-a5b6-baa0af952891-istiod-ca-cert\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.469974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.469951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-certs\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.470054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.470035    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-socket\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.471769 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.471738    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-podinfo\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.471860 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.471802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-envoy\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.478021 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.477997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2t8t\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-kube-api-access-z2t8t\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.479225 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.479207    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-token\") pod \"e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") " pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.644979 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.644948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:40.938776 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.938751    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"]
Sep 08 15:12:40.940720 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:12:40.940693    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0586b3_cbc8_422a_a5b6_baa0af952891.slice/crio-31dd398b96aec48d8216150269435447443af5b28d79a7468fde9929be142f4d WatchSource:0}: Error finding container 31dd398b96aec48d8216150269435447443af5b28d79a7468fde9929be142f4d: Status 404 returned error can't find the container with id 31dd398b96aec48d8216150269435447443af5b28d79a7468fde9929be142f4d
Sep 08 15:12:40.942818 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.942783    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:12:40.942910 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.942846    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:12:40.942910 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:40.942874    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:12:41.341990 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:41.341919    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd" event={"ID":"2f0586b3-cbc8-422a-a5b6-baa0af952891","Type":"ContainerStarted","Data":"28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf"}
Sep 08 15:12:41.341990 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:41.341967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd" event={"ID":"2f0586b3-cbc8-422a-a5b6-baa0af952891","Type":"ContainerStarted","Data":"31dd398b96aec48d8216150269435447443af5b28d79a7468fde9929be142f4d"}
Sep 08 15:12:41.372407 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:41.372364    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd" podStartSLOduration=1.372350467 podStartE2EDuration="1.372350467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:41.370532547 +0000 UTC m=+1052.517553453" watchObservedRunningTime="2026-09-08 15:12:41.372350467 +0000 UTC m=+1052.519371374"
Sep 08 15:12:41.645874 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:41.645848    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:42.651196 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:42.651162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:43.354978 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:43.354946    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:43.356082 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:43.356062    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:12:44.737365 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.737335    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:12:44.809311 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809254    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-data\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-credential-socket\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809333    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istiod-ca-cert\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809355    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-envoy\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809389    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24wsf\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-kube-api-access-24wsf\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809425    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-podinfo\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-token\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809545    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-socket\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809571    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-certs\") pod \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\" (UID: \"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc\") "
Sep 08 15:12:44.809763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:12:44.809763 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:12:44.810007 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809796    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:12:44.810007 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809810    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:12:44.810007 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.809872    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.810654 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.810603    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:12:44.810785 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.810688    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.816237 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.812722    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-kube-api-access-24wsf" (OuterVolumeSpecName: "kube-api-access-24wsf") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "kube-api-access-24wsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:12:44.818768 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.818740    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:12:44.819101 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.819074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:12:44.820024 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.819971    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" (UID: "15e15d5e-c4b7-4eba-bcd0-9f475228e5cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:12:44.911601 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911576    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.911601 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911598    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.911751 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911627    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24wsf\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-kube-api-access-24wsf\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.911751 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911638    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.911751 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911647    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.911751 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911655    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:44.911751 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:44.911663    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:12:45.369283 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.369254    2579 generic.go:356] "Generic (PLEG): container finished" podID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerID="63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc" exitCode=0
Sep 08 15:12:45.369443 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.369322    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"
Sep 08 15:12:45.369443 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.369343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" event={"ID":"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc","Type":"ContainerDied","Data":"63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc"}
Sep 08 15:12:45.369443 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.369418    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd" event={"ID":"15e15d5e-c4b7-4eba-bcd0-9f475228e5cc","Type":"ContainerDied","Data":"16703c2d7b432bcdd80e32e2dda935069f651d689f83a8f201616b79b1a933ac"}
Sep 08 15:12:45.369592 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.369461    2579 scope.go:117] "RemoveContainer" containerID="63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc"
Sep 08 15:12:45.379329 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.379310    2579 scope.go:117] "RemoveContainer" containerID="2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"
Sep 08 15:12:45.388132 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.388116    2579 scope.go:117] "RemoveContainer" containerID="63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc"
Sep 08 15:12:45.388391 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:12:45.388373    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc\": container with ID starting with 63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc not found: ID does not exist" containerID="63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc"
Sep 08 15:12:45.388474 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.388397    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc"} err="failed to get container status \"63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc\": rpc error: code = NotFound desc = could not find container \"63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc\": container with ID starting with 63b87860db2b2dd475d10db6338f5036460cb2c424eaf14cc93dc786abbc15bc not found: ID does not exist"
Sep 08 15:12:45.388474 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.388411    2579 scope.go:117] "RemoveContainer" containerID="2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"
Sep 08 15:12:45.388678 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:12:45.388661    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2\": container with ID starting with 2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2 not found: ID does not exist" containerID="2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"
Sep 08 15:12:45.388718 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.388681    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2"} err="failed to get container status \"2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2\": rpc error: code = NotFound desc = could not find container \"2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2\": container with ID starting with 2f4760ba3d550eef92a02c994cc5ab629313899f230da50a675df0fef6de68b2 not found: ID does not exist"
Sep 08 15:12:45.393252 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.393229    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"]
Sep 08 15:12:45.397470 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:45.397436    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-ac43b2-openshift-default-6f77d7bbd-hz9sd"]
Sep 08 15:12:47.389579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:47.389547    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" path="/var/lib/kubelet/pods/15e15d5e-c4b7-4eba-bcd0-9f475228e5cc/volumes"
Sep 08 15:12:48.973780 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.973751    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"]
Sep 08 15:12:48.974239 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.974224    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy"
Sep 08 15:12:48.974239 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.974240    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy"
Sep 08 15:12:48.974315 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.974257    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy"
Sep 08 15:12:48.974315 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.974263    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy"
Sep 08 15:12:48.974380 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.974327    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy"
Sep 08 15:12:48.978962 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.978941    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:48.981942 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.981918    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b04cf783-openshift-default-dockercfg-vkzc7\""
Sep 08 15:12:48.995218 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:48.995192    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"]
Sep 08 15:12:49.048035 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048004    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-data\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048170 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-credential-socket\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048170 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-envoy\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048170 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048133    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-certs\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048316 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048192    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68ba853b-978a-411c-af71-c86a4ba9def9-istio-podinfo\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048316 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hgcl\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-kube-api-access-9hgcl\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048387 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68ba853b-978a-411c-af71-c86a4ba9def9-istiod-ca-cert\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048387 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048362    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-socket\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.048476 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.048389    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-istio-token\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149186 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68ba853b-978a-411c-af71-c86a4ba9def9-istiod-ca-cert\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149366 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-socket\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149366 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-istio-token\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149366 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-data\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149366 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-credential-socket\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149366 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-envoy\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-certs\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68ba853b-978a-411c-af71-c86a4ba9def9-istio-podinfo\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149804 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-socket\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149804 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hgcl\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-kube-api-access-9hgcl\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.149934 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.149903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-credential-socket\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.150043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.150023    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68ba853b-978a-411c-af71-c86a4ba9def9-istiod-ca-cert\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.150130 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.150056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-certs\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.150176 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.150149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-data\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.151764 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.151731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-envoy\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.152059 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.152039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68ba853b-978a-411c-af71-c86a4ba9def9-istio-podinfo\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.163469 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.163422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-istio-token\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.163718 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.163696    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hgcl\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-kube-api-access-9hgcl\") pod \"e2e-mt-b04cf783-openshift-default-655d755844-29rvw\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") " pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.289737 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.289679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:49.570908 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.570884    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"]
Sep 08 15:12:49.572502 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:12:49.572474    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68ba853b_978a_411c_af71_c86a4ba9def9.slice/crio-9ad20dd707feca072c57d61d672b94ffdfebaafbb52c04cddd55bf749dd30db7 WatchSource:0}: Error finding container 9ad20dd707feca072c57d61d672b94ffdfebaafbb52c04cddd55bf749dd30db7: Status 404 returned error can't find the container with id 9ad20dd707feca072c57d61d672b94ffdfebaafbb52c04cddd55bf749dd30db7
Sep 08 15:12:49.574508 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.574444    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:12:49.574581 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.574540    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:12:49.574581 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:49.574568    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:12:50.409336 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:50.409301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" event={"ID":"68ba853b-978a-411c-af71-c86a4ba9def9","Type":"ContainerStarted","Data":"02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"}
Sep 08 15:12:50.409693 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:50.409347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" event={"ID":"68ba853b-978a-411c-af71-c86a4ba9def9","Type":"ContainerStarted","Data":"9ad20dd707feca072c57d61d672b94ffdfebaafbb52c04cddd55bf749dd30db7"}
Sep 08 15:12:50.431549 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:50.431505    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podStartSLOduration=2.431489264 podStartE2EDuration="2.431489264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:50.42995753 +0000 UTC m=+1061.576978436" watchObservedRunningTime="2026-09-08 15:12:50.431489264 +0000 UTC m=+1061.578510182"
Sep 08 15:12:51.290841 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:51.290805    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:51.296327 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:51.296301    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:51.415392 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:51.415360    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:51.416157 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:51.416140    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:12:53.512221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.512192    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"]
Sep 08 15:12:53.512707 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.512692    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e15d5e-c4b7-4eba-bcd0-9f475228e5cc" containerName="istio-proxy"
Sep 08 15:12:53.515941 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.515924    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.518838 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.518817    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b04cf783-serving-cert\""
Sep 08 15:12:53.529184 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.529159    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"]
Sep 08 15:12:53.590042 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.590018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-openshift-service-ca\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.590162 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.590053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hg54\" (UniqueName: \"kubernetes.io/projected/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-kube-api-access-4hg54\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.590162 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.590095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-metrics-certs\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.590273 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.590174    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.691290 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.691252    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-openshift-service-ca\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.691290 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.691293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hg54\" (UniqueName: \"kubernetes.io/projected/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-kube-api-access-4hg54\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.691593 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.691333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-metrics-certs\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.691593 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.691390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.691593 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:12:53.691539    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-serving-cert: secret "maas-api-e2e-mt-b04cf783-serving-cert" not found
Sep 08 15:12:53.691757 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:12:53.691607    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls podName:039bd440-f7a5-44ec-947c-aeaf7aca0d6d nodeName:}" failed. No retries permitted until 2026-09-08 15:12:54.191586613 +0000 UTC m=+1065.338607517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls") pod "maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" (UID: "039bd440-f7a5-44ec-947c-aeaf7aca0d6d") : secret "maas-api-e2e-mt-b04cf783-serving-cert" not found
Sep 08 15:12:53.692000 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.691980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-openshift-service-ca\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.693731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.693709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-metrics-certs\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:53.705077 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:53.705056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hg54\" (UniqueName: \"kubernetes.io/projected/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-kube-api-access-4hg54\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:54.196925 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:54.196885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:54.199353 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:54.199327    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls\") pod \"maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:54.428518 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:54.428443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:54.707984 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:54.707945    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"]
Sep 08 15:12:54.708774 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:12:54.708746    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039bd440_f7a5_44ec_947c_aeaf7aca0d6d.slice/crio-978ebe0ec897459380229601c62ca945d16f6140662b2fd6ab598bfd935bf873 WatchSource:0}: Error finding container 978ebe0ec897459380229601c62ca945d16f6140662b2fd6ab598bfd935bf873: Status 404 returned error can't find the container with id 978ebe0ec897459380229601c62ca945d16f6140662b2fd6ab598bfd935bf873
Sep 08 15:12:55.440013 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:55.439923    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" event={"ID":"039bd440-f7a5-44ec-947c-aeaf7aca0d6d","Type":"ContainerStarted","Data":"f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c"}
Sep 08 15:12:55.440013 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:55.439982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" event={"ID":"039bd440-f7a5-44ec-947c-aeaf7aca0d6d","Type":"ContainerStarted","Data":"978ebe0ec897459380229601c62ca945d16f6140662b2fd6ab598bfd935bf873"}
Sep 08 15:12:55.440013 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:55.440011    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:12:55.458548 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:12:55.458501    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" podStartSLOduration=2.005232719 podStartE2EDuration="2.458486028s" totalImagesPullingTime="453.253309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:55.455798798 +0000 UTC m=+1066.602819706" watchObservedRunningTime="2026-09-08 15:12:55.458486028 +0000 UTC m=+1066.605506935"
Sep 08 15:13:01.101964 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:01.101932    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"]
Sep 08 15:13:01.102348 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:01.102139    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd" podUID="2f0586b3-cbc8-422a-a5b6-baa0af952891" containerName="istio-proxy" containerID="cri-o://28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf" gracePeriod=30
Sep 08 15:13:01.453068 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:01.453041    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:13:06.401059 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.401024    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:13:06.506322 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.506291    2579 generic.go:356] "Generic (PLEG): container finished" podID="2f0586b3-cbc8-422a-a5b6-baa0af952891" containerID="28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf" exitCode=0
Sep 08 15:13:06.506501 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.506336    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"
Sep 08 15:13:06.506501 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.506376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd" event={"ID":"2f0586b3-cbc8-422a-a5b6-baa0af952891","Type":"ContainerDied","Data":"28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf"}
Sep 08 15:13:06.506501 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.506429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd" event={"ID":"2f0586b3-cbc8-422a-a5b6-baa0af952891","Type":"ContainerDied","Data":"31dd398b96aec48d8216150269435447443af5b28d79a7468fde9929be142f4d"}
Sep 08 15:13:06.506501 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.506480    2579 scope.go:117] "RemoveContainer" containerID="28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf"
Sep 08 15:13:06.515836 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.515818    2579 scope.go:117] "RemoveContainer" containerID="28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf"
Sep 08 15:13:06.515895 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.515822    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-data\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.515967 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.515950    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-token\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516030 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.515998    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-socket\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516030 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516025    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-envoy\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516138 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516030    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-data" (OuterVolumeSpecName: "istio-data") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.516138 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-certs\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516138 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0586b3-cbc8-422a-a5b6-baa0af952891-istiod-ca-cert\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516164    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-credential-socket\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516219    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2t8t\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-kube-api-access-z2t8t\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516264    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-podinfo\") pod \"2f0586b3-cbc8-422a-a5b6-baa0af952891\" (UID: \"2f0586b3-cbc8-422a-a5b6-baa0af952891\") "
Sep 08 15:13:06.516428 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:06.516325    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf\": container with ID starting with 28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf not found: ID does not exist" containerID="28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf"
Sep 08 15:13:06.516428 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516363    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf"} err="failed to get container status \"28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf\": rpc error: code = NotFound desc = could not find container \"28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf\": container with ID starting with 28ea99198fdc397e6c71b4ea3f4859491abaf1ccdf8cc11f17c8d6cad7c165cf not found: ID does not exist"
Sep 08 15:13:06.516565 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516463    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.516565 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516483    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.516672 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516633    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0586b3-cbc8-422a-a5b6-baa0af952891-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:06.516727 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516673    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.516727 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516700    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.516727 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516717    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.516870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.516800    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.518466 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.518419    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:06.518558 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.518428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-kube-api-access-z2t8t" (OuterVolumeSpecName: "kube-api-access-z2t8t") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "kube-api-access-z2t8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:06.518558 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.518481    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-token" (OuterVolumeSpecName: "istio-token") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:06.518705 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.518690    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2f0586b3-cbc8-422a-a5b6-baa0af952891" (UID: "2f0586b3-cbc8-422a-a5b6-baa0af952891"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:13:06.617577 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.617548    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.617577 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.617571    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2t8t\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-kube-api-access-z2t8t\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.617577 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.617581    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.617774 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.617591    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.617774 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.617601    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2f0586b3-cbc8-422a-a5b6-baa0af952891-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.617774 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.617609    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2f0586b3-cbc8-422a-a5b6-baa0af952891-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:06.829350 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.829314    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"]
Sep 08 15:13:06.832732 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:06.832707    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-e3e2a7-openshift-default-858f566c74-ghnhd"]
Sep 08 15:13:07.389790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:07.389759    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0586b3-cbc8-422a-a5b6-baa0af952891" path="/var/lib/kubelet/pods/2f0586b3-cbc8-422a-a5b6-baa0af952891/volumes"
Sep 08 15:13:10.540061 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.540022    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"]
Sep 08 15:13:10.540519 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.540272    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w" podUID="98f83295-c9f7-4009-a9a2-509ec3cc810f" containerName="payload-pre-processing" containerID="cri-o://3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc" gracePeriod=30
Sep 08 15:13:10.812791 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.812765    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:13:10.956970 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.956932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bcfpv\" (UniqueName: \"kubernetes.io/projected/98f83295-c9f7-4009-a9a2-509ec3cc810f-kube-api-access-bcfpv\") pod \"98f83295-c9f7-4009-a9a2-509ec3cc810f\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") "
Sep 08 15:13:10.957150 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.957077    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f83295-c9f7-4009-a9a2-509ec3cc810f-plugins-config-volume\") pod \"98f83295-c9f7-4009-a9a2-509ec3cc810f\" (UID: \"98f83295-c9f7-4009-a9a2-509ec3cc810f\") "
Sep 08 15:13:10.957480 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.957436    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98f83295-c9f7-4009-a9a2-509ec3cc810f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98f83295-c9f7-4009-a9a2-509ec3cc810f" (UID: "98f83295-c9f7-4009-a9a2-509ec3cc810f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:10.959138 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:10.959108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98f83295-c9f7-4009-a9a2-509ec3cc810f-kube-api-access-bcfpv" (OuterVolumeSpecName: "kube-api-access-bcfpv") pod "98f83295-c9f7-4009-a9a2-509ec3cc810f" (UID: "98f83295-c9f7-4009-a9a2-509ec3cc810f"). InnerVolumeSpecName "kube-api-access-bcfpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:11.057838 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.057765    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98f83295-c9f7-4009-a9a2-509ec3cc810f-plugins-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:11.057838 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.057793    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bcfpv\" (UniqueName: \"kubernetes.io/projected/98f83295-c9f7-4009-a9a2-509ec3cc810f-kube-api-access-bcfpv\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:11.552310 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.552282    2579 generic.go:356] "Generic (PLEG): container finished" podID="98f83295-c9f7-4009-a9a2-509ec3cc810f" containerID="3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc" exitCode=0
Sep 08 15:13:11.552750 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.552330    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"
Sep 08 15:13:11.552750 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.552363    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w" event={"ID":"98f83295-c9f7-4009-a9a2-509ec3cc810f","Type":"ContainerDied","Data":"3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc"}
Sep 08 15:13:11.552750 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.552437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w" event={"ID":"98f83295-c9f7-4009-a9a2-509ec3cc810f","Type":"ContainerDied","Data":"6de14f1a987fec4add52a2287eec81d66e75cef8d6933e4dd466586a4711623e"}
Sep 08 15:13:11.552750 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.552497    2579 scope.go:117] "RemoveContainer" containerID="3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc"
Sep 08 15:13:11.554560 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.554527    2579 generic.go:356] "Generic (PLEG): container finished" podID="68ba853b-978a-411c-af71-c86a4ba9def9" containerID="02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab" exitCode=0
Sep 08 15:13:11.555207 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.554704    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" event={"ID":"68ba853b-978a-411c-af71-c86a4ba9def9","Type":"ContainerDied","Data":"02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"}
Sep 08 15:13:11.555207 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.555137    2579 scope.go:117] "RemoveContainer" containerID="02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"
Sep 08 15:13:11.556331 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.556305    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:11.556426 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.556385    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:11.556426 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.556421    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:11.562031 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.561998    2579 scope.go:117] "RemoveContainer" containerID="3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc"
Sep 08 15:13:11.562309 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:11.562286    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc\": container with ID starting with 3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc not found: ID does not exist" containerID="3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc"
Sep 08 15:13:11.562378 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.562321    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc"} err="failed to get container status \"3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc\": rpc error: code = NotFound desc = could not find container \"3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc\": container with ID starting with 3a1b8a4f7fb63dae7231af67a408bfd1a29f730d8b31ed581718aafa3ea08dfc not found: ID does not exist"
Sep 08 15:13:11.591139 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.591118    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"]
Sep 08 15:13:11.598231 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:11.598209    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a1592f-64c4fdbcc8-dvp8w"]
Sep 08 15:13:12.568676 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:12.568635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" event={"ID":"68ba853b-978a-411c-af71-c86a4ba9def9","Type":"ContainerStarted","Data":"8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa"}
Sep 08 15:13:13.290064 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:13.290020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:13:13.290277 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:13.290244    2579 patch_prober.go:28] interesting pod/e2e-mt-b04cf783-openshift-default-655d755844-29rvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:13:13.290368 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:13.290299    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:13:13.396160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:13.396119    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98f83295-c9f7-4009-a9a2-509ec3cc810f" path="/var/lib/kubelet/pods/98f83295-c9f7-4009-a9a2-509ec3cc810f/volumes"
Sep 08 15:13:14.290961 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:14.290923    2579 patch_prober.go:28] interesting pod/e2e-mt-b04cf783-openshift-default-655d755844-29rvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:13:14.291338 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:14.290987    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:13:15.290208 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:15.290171    2579 patch_prober.go:28] interesting pod/e2e-mt-b04cf783-openshift-default-655d755844-29rvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:13:15.290382 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:15.290229    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:13:16.290335 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:16.290296    2579 patch_prober.go:28] interesting pod/e2e-mt-b04cf783-openshift-default-655d755844-29rvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:13:16.290723 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:16.290357    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:13:17.289918 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:17.289885    2579 patch_prober.go:28] interesting pod/e2e-mt-b04cf783-openshift-default-655d755844-29rvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:13:17.290097 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:17.289939    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:13:18.294788 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:18.294756    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:13:18.295149 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:18.295039    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:13:18.295802 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:18.295784    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:13:29.799057 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:29.799027    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"]
Sep 08 15:13:29.799485 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:29.799223    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" podUID="6367b3b4-9dd2-4156-8202-9fe2525674f2" containerName="maas-api" containerID="cri-o://d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb" gracePeriod=30
Sep 08 15:13:29.879161 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:29.879129    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"]
Sep 08 15:13:29.879367 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:29.879341    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh" podUID="c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" containerName="payload-pre-processing" containerID="cri-o://24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df" gracePeriod=30
Sep 08 15:13:30.129920 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.129894    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:13:30.162313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.162287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:13:30.224071 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-metrics-certs\") pod \"6367b3b4-9dd2-4156-8202-9fe2525674f2\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") "
Sep 08 15:13:30.224223 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224102    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chshk\" (UniqueName: \"kubernetes.io/projected/6367b3b4-9dd2-4156-8202-9fe2525674f2-kube-api-access-chshk\") pod \"6367b3b4-9dd2-4156-8202-9fe2525674f2\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") "
Sep 08 15:13:30.224223 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224145    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-plugins-config-volume\") pod \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") "
Sep 08 15:13:30.224321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls\") pod \"6367b3b4-9dd2-4156-8202-9fe2525674f2\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") "
Sep 08 15:13:30.224321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224266    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6367b3b4-9dd2-4156-8202-9fe2525674f2-openshift-service-ca\") pod \"6367b3b4-9dd2-4156-8202-9fe2525674f2\" (UID: \"6367b3b4-9dd2-4156-8202-9fe2525674f2\") "
Sep 08 15:13:30.224321 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224318    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2dvs\" (UniqueName: \"kubernetes.io/projected/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-kube-api-access-z2dvs\") pod \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\" (UID: \"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1\") "
Sep 08 15:13:30.224691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" (UID: "c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:30.224691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.224686    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6367b3b4-9dd2-4156-8202-9fe2525674f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6367b3b4-9dd2-4156-8202-9fe2525674f2" (UID: "6367b3b4-9dd2-4156-8202-9fe2525674f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:30.226435 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.226401    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6367b3b4-9dd2-4156-8202-9fe2525674f2" (UID: "6367b3b4-9dd2-4156-8202-9fe2525674f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:30.226435 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.226417    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-kube-api-access-z2dvs" (OuterVolumeSpecName: "kube-api-access-z2dvs") pod "c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" (UID: "c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1"). InnerVolumeSpecName "kube-api-access-z2dvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:30.226704 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.226682    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6367b3b4-9dd2-4156-8202-9fe2525674f2" (UID: "6367b3b4-9dd2-4156-8202-9fe2525674f2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:30.226775 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.226685    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6367b3b4-9dd2-4156-8202-9fe2525674f2-kube-api-access-chshk" (OuterVolumeSpecName: "kube-api-access-chshk") pod "6367b3b4-9dd2-4156-8202-9fe2525674f2" (UID: "6367b3b4-9dd2-4156-8202-9fe2525674f2"). InnerVolumeSpecName "kube-api-access-chshk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:30.325797 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.325770    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6367b3b4-9dd2-4156-8202-9fe2525674f2-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.325797 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.325795    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2dvs\" (UniqueName: \"kubernetes.io/projected/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-kube-api-access-z2dvs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.325985 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.325805    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.325985 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.325813    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chshk\" (UniqueName: \"kubernetes.io/projected/6367b3b4-9dd2-4156-8202-9fe2525674f2-kube-api-access-chshk\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.325985 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.325821    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1-plugins-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.325985 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.325831    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6367b3b4-9dd2-4156-8202-9fe2525674f2-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:30.678303 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.678267    2579 generic.go:356] "Generic (PLEG): container finished" podID="6367b3b4-9dd2-4156-8202-9fe2525674f2" containerID="d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb" exitCode=0
Sep 08 15:13:30.678521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.678309    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"
Sep 08 15:13:30.678521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.678356    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" event={"ID":"6367b3b4-9dd2-4156-8202-9fe2525674f2","Type":"ContainerDied","Data":"d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb"}
Sep 08 15:13:30.678521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.678410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95" event={"ID":"6367b3b4-9dd2-4156-8202-9fe2525674f2","Type":"ContainerDied","Data":"b4fc36f16d558f1dbc0a83d1a8ddfd53d48574775c4b54817db6c26c952a9bf6"}
Sep 08 15:13:30.678521 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.678443    2579 scope.go:117] "RemoveContainer" containerID="d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb"
Sep 08 15:13:30.679919 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.679896    2579 generic.go:356] "Generic (PLEG): container finished" podID="c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" containerID="24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df" exitCode=0
Sep 08 15:13:30.680028 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.679947    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"
Sep 08 15:13:30.680028 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.679947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh" event={"ID":"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1","Type":"ContainerDied","Data":"24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df"}
Sep 08 15:13:30.680110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.680061    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh" event={"ID":"c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1","Type":"ContainerDied","Data":"197ab639c0145cc6e7b2a777eb07740f4daa48f15a6c8efdf8046edb63d54837"}
Sep 08 15:13:30.687820 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.687800    2579 scope.go:117] "RemoveContainer" containerID="d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb"
Sep 08 15:13:30.688096 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:30.688075    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb\": container with ID starting with d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb not found: ID does not exist" containerID="d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb"
Sep 08 15:13:30.688159 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.688106    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb"} err="failed to get container status \"d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb\": rpc error: code = NotFound desc = could not find container \"d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb\": container with ID starting with d8d070dbd195e6ee595670d349ae1540a7c359d0306ad63d45ea7864e02d1dbb not found: ID does not exist"
Sep 08 15:13:30.688159 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.688122    2579 scope.go:117] "RemoveContainer" containerID="24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df"
Sep 08 15:13:30.696870 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.696854    2579 scope.go:117] "RemoveContainer" containerID="24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df"
Sep 08 15:13:30.697119 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:30.697102    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df\": container with ID starting with 24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df not found: ID does not exist" containerID="24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df"
Sep 08 15:13:30.697184 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.697123    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df"} err="failed to get container status \"24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df\": rpc error: code = NotFound desc = could not find container \"24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df\": container with ID starting with 24e1031b355663d9cd39ddfa6b830772b74465fd6c3415abefd09612a8cd72df not found: ID does not exist"
Sep 08 15:13:30.707906 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.707885    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"]
Sep 08 15:13:30.715498 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.715479    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-eba68d-7fb8fdcf99-dnp95"]
Sep 08 15:13:30.726052 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.726030    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"]
Sep 08 15:13:30.730681 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:30.730663    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-eba68d-697c848698-h9zlh"]
Sep 08 15:13:31.388014 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:31.387980    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6367b3b4-9dd2-4156-8202-9fe2525674f2" path="/var/lib/kubelet/pods/6367b3b4-9dd2-4156-8202-9fe2525674f2/volumes"
Sep 08 15:13:31.388369 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:31.388320    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" path="/var/lib/kubelet/pods/c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1/volumes"
Sep 08 15:13:35.755355 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:35.755324    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"]
Sep 08 15:13:35.755833 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:35.755621    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" podUID="039bd440-f7a5-44ec-947c-aeaf7aca0d6d" containerName="maas-api" containerID="cri-o://f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c" gracePeriod=30
Sep 08 15:13:36.004265 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.004243    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:13:36.078794 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.078729    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls\") pod \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") "
Sep 08 15:13:36.078794 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.078781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hg54\" (UniqueName: \"kubernetes.io/projected/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-kube-api-access-4hg54\") pod \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") "
Sep 08 15:13:36.078959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.078818    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-metrics-certs\") pod \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") "
Sep 08 15:13:36.078959 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.078846    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-openshift-service-ca\") pod \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\" (UID: \"039bd440-f7a5-44ec-947c-aeaf7aca0d6d\") "
Sep 08 15:13:36.079266 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.079242    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "039bd440-f7a5-44ec-947c-aeaf7aca0d6d" (UID: "039bd440-f7a5-44ec-947c-aeaf7aca0d6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:36.080891 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.080867    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-kube-api-access-4hg54" (OuterVolumeSpecName: "kube-api-access-4hg54") pod "039bd440-f7a5-44ec-947c-aeaf7aca0d6d" (UID: "039bd440-f7a5-44ec-947c-aeaf7aca0d6d"). InnerVolumeSpecName "kube-api-access-4hg54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:36.081009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.080889    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "039bd440-f7a5-44ec-947c-aeaf7aca0d6d" (UID: "039bd440-f7a5-44ec-947c-aeaf7aca0d6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:36.081009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.080906    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "039bd440-f7a5-44ec-947c-aeaf7aca0d6d" (UID: "039bd440-f7a5-44ec-947c-aeaf7aca0d6d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:36.180372 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.180342    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:36.180372 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.180369    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:36.180372 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.180379    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:36.180629 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.180390    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hg54\" (UniqueName: \"kubernetes.io/projected/039bd440-f7a5-44ec-947c-aeaf7aca0d6d-kube-api-access-4hg54\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:36.717890 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.717852    2579 generic.go:356] "Generic (PLEG): container finished" podID="039bd440-f7a5-44ec-947c-aeaf7aca0d6d" containerID="f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c" exitCode=0
Sep 08 15:13:36.718053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.717896    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"
Sep 08 15:13:36.718053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.717937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" event={"ID":"039bd440-f7a5-44ec-947c-aeaf7aca0d6d","Type":"ContainerDied","Data":"f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c"}
Sep 08 15:13:36.718053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.717986    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw" event={"ID":"039bd440-f7a5-44ec-947c-aeaf7aca0d6d","Type":"ContainerDied","Data":"978ebe0ec897459380229601c62ca945d16f6140662b2fd6ab598bfd935bf873"}
Sep 08 15:13:36.718053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.718007    2579 scope.go:117] "RemoveContainer" containerID="f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c"
Sep 08 15:13:36.727582 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.727553    2579 scope.go:117] "RemoveContainer" containerID="f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c"
Sep 08 15:13:36.727822 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:36.727802    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c\": container with ID starting with f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c not found: ID does not exist" containerID="f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c"
Sep 08 15:13:36.727871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.727830    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c"} err="failed to get container status \"f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c\": rpc error: code = NotFound desc = could not find container \"f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c\": container with ID starting with f60623a03a1192dabf91a4111de642109bae9e512fc312798f6daf3baeddb77c not found: ID does not exist"
Sep 08 15:13:36.740493 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.740470    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"]
Sep 08 15:13:36.744457 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:36.744420    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b04cf783-6f87c56d9-6bvxw"]
Sep 08 15:13:37.388201 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:37.388171    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="039bd440-f7a5-44ec-947c-aeaf7aca0d6d" path="/var/lib/kubelet/pods/039bd440-f7a5-44ec-947c-aeaf7aca0d6d/volumes"
Sep 08 15:13:42.810170 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:42.810138    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"]
Sep 08 15:13:42.810786 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:42.810373    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy" containerID="cri-o://8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa" gracePeriod=30
Sep 08 15:13:43.056272 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056240    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"]
Sep 08 15:13:43.056693 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056677    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6367b3b4-9dd2-4156-8202-9fe2525674f2" containerName="maas-api"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056695    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6367b3b4-9dd2-4156-8202-9fe2525674f2" containerName="maas-api"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056712    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" containerName="payload-pre-processing"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056718    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" containerName="payload-pre-processing"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056731    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0586b3-cbc8-422a-a5b6-baa0af952891" containerName="istio-proxy"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056735    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0586b3-cbc8-422a-a5b6-baa0af952891" containerName="istio-proxy"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056742    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="039bd440-f7a5-44ec-947c-aeaf7aca0d6d" containerName="maas-api"
Sep 08 15:13:43.056747 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056748    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="039bd440-f7a5-44ec-947c-aeaf7aca0d6d" containerName="maas-api"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056761    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98f83295-c9f7-4009-a9a2-509ec3cc810f" containerName="payload-pre-processing"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056767    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="98f83295-c9f7-4009-a9a2-509ec3cc810f" containerName="payload-pre-processing"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056823    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="039bd440-f7a5-44ec-947c-aeaf7aca0d6d" containerName="maas-api"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056832    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c97a7c0d-7fcb-4442-a1e1-4e7f40d495c1" containerName="payload-pre-processing"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056840    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6367b3b4-9dd2-4156-8202-9fe2525674f2" containerName="maas-api"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056848    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0586b3-cbc8-422a-a5b6-baa0af952891" containerName="istio-proxy"
Sep 08 15:13:43.056972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.056856    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="98f83295-c9f7-4009-a9a2-509ec3cc810f" containerName="payload-pre-processing"
Sep 08 15:13:43.058863 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.058848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.061605 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.061546    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:13:43.064364 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.064342    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-ffa941-serving-cert\""
Sep 08 15:13:43.064502 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.064490    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-857r2\""
Sep 08 15:13:43.085284 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.085263    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"]
Sep 08 15:13:43.144826 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.144799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.144970 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.144890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.144970 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.144917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8101e690-bd4b-4147-b418-d72dbe8b0afa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.144970 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.144948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwrfq\" (UniqueName: \"kubernetes.io/projected/8101e690-bd4b-4147-b418-d72dbe8b0afa-kube-api-access-xwrfq\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.245732 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.245696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.245732 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.245734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8101e690-bd4b-4147-b418-d72dbe8b0afa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.245977 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.245773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwrfq\" (UniqueName: \"kubernetes.io/projected/8101e690-bd4b-4147-b418-d72dbe8b0afa-kube-api-access-xwrfq\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.245977 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.245836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.246436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.246414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8101e690-bd4b-4147-b418-d72dbe8b0afa-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.248130 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.248108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.248221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.248166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.272166 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.272131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwrfq\" (UniqueName: \"kubernetes.io/projected/8101e690-bd4b-4147-b418-d72dbe8b0afa-kube-api-access-xwrfq\") pod \"maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.369037 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.368960    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:43.653319 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.653282    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"]
Sep 08 15:13:43.762069 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:43.762030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d" event={"ID":"8101e690-bd4b-4147-b418-d72dbe8b0afa","Type":"ContainerStarted","Data":"e26a5aca35df9721d7cec8ebe4b8c12d46bf9fc70adfd2f2d5c8142b5a3808fb"}
Sep 08 15:13:44.769901 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:44.769862    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d" event={"ID":"8101e690-bd4b-4147-b418-d72dbe8b0afa","Type":"ContainerStarted","Data":"c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8"}
Sep 08 15:13:44.770260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:44.769934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:44.789404 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:44.789358    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d" podStartSLOduration=1.298772168 podStartE2EDuration="1.789344599s" totalImagesPullingTime="490.572431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:44.78807373 +0000 UTC m=+1115.935094663" watchObservedRunningTime="2026-09-08 15:13:44.789344599 +0000 UTC m=+1115.936365506"
Sep 08 15:13:48.075816 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.075746    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:13:48.193793 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.193760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-istio-token\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.193793 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.193798    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-data\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194024 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.193847    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68ba853b-978a-411c-af71-c86a4ba9def9-istiod-ca-cert\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194024 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194008    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-envoy\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194038    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68ba853b-978a-411c-af71-c86a4ba9def9-istio-podinfo\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194104    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-certs\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-socket\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hgcl\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-kube-api-access-9hgcl\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194194    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-credential-socket\") pod \"68ba853b-978a-411c-af71-c86a4ba9def9\" (UID: \"68ba853b-978a-411c-af71-c86a4ba9def9\") "
Sep 08 15:13:48.194287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194213    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-data" (OuterVolumeSpecName: "istio-data") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:48.194287 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194233    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68ba853b-978a-411c-af71-c86a4ba9def9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:48.194535 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194470    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:48.194659 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194635    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.194659 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:48.194849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194658    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68ba853b-978a-411c-af71-c86a4ba9def9-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.194849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194700    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.194849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.194736    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:48.196227 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.196205    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:48.196331 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.196221    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-istio-token" (OuterVolumeSpecName: "istio-token") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:48.196564 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.196539    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68ba853b-978a-411c-af71-c86a4ba9def9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:13:48.196564 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.196551    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-kube-api-access-9hgcl" (OuterVolumeSpecName: "kube-api-access-9hgcl") pod "68ba853b-978a-411c-af71-c86a4ba9def9" (UID: "68ba853b-978a-411c-af71-c86a4ba9def9"). InnerVolumeSpecName "kube-api-access-9hgcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:48.296160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.296122    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hgcl\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-kube-api-access-9hgcl\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.296160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.296152    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.296160 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.296163    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68ba853b-978a-411c-af71-c86a4ba9def9-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.296403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.296171    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.296403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.296179    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68ba853b-978a-411c-af71-c86a4ba9def9-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.296403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.296188    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68ba853b-978a-411c-af71-c86a4ba9def9-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:13:48.794561 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.794530    2579 generic.go:356] "Generic (PLEG): container finished" podID="68ba853b-978a-411c-af71-c86a4ba9def9" containerID="8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa" exitCode=0
Sep 08 15:13:48.794731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.794580    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"
Sep 08 15:13:48.794731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.794608    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" event={"ID":"68ba853b-978a-411c-af71-c86a4ba9def9","Type":"ContainerDied","Data":"8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa"}
Sep 08 15:13:48.794731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.794649    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw" event={"ID":"68ba853b-978a-411c-af71-c86a4ba9def9","Type":"ContainerDied","Data":"9ad20dd707feca072c57d61d672b94ffdfebaafbb52c04cddd55bf749dd30db7"}
Sep 08 15:13:48.794731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.794672    2579 scope.go:117] "RemoveContainer" containerID="8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa"
Sep 08 15:13:48.805169 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.805153    2579 scope.go:117] "RemoveContainer" containerID="02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"
Sep 08 15:13:48.813403 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.813388    2579 scope.go:117] "RemoveContainer" containerID="8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa"
Sep 08 15:13:48.813743 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:48.813724    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa\": container with ID starting with 8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa not found: ID does not exist" containerID="8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa"
Sep 08 15:13:48.813833 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.813756    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa"} err="failed to get container status \"8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa\": rpc error: code = NotFound desc = could not find container \"8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa\": container with ID starting with 8a488b218de2186c81c8bfd95ab38a5e542ccb5a7a8d87eacd01d6961b7d8daa not found: ID does not exist"
Sep 08 15:13:48.813833 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.813780    2579 scope.go:117] "RemoveContainer" containerID="02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"
Sep 08 15:13:48.814031 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:13:48.814014    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab\": container with ID starting with 02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab not found: ID does not exist" containerID="02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"
Sep 08 15:13:48.814081 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.814038    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab"} err="failed to get container status \"02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab\": rpc error: code = NotFound desc = could not find container \"02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab\": container with ID starting with 02b756f28307bdb9b7d06a1c5b3066d96b7551466249a1913d6075619ccf15ab not found: ID does not exist"
Sep 08 15:13:48.817722 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.817701    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"]
Sep 08 15:13:48.824779 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:48.824759    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b04cf783-openshift-default-655d755844-29rvw"]
Sep 08 15:13:49.390044 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:49.390015    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" path="/var/lib/kubelet/pods/68ba853b-978a-411c-af71-c86a4ba9def9/volumes"
Sep 08 15:13:50.781089 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:50.781059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:13:56.811902 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.811869    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"]
Sep 08 15:13:56.812476 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.812440    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy"
Sep 08 15:13:56.812476 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.812477    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy"
Sep 08 15:13:56.812654 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.812503    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy"
Sep 08 15:13:56.812654 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.812511    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy"
Sep 08 15:13:56.812654 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.812645    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy"
Sep 08 15:13:56.815844 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.815825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.818221 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.818202    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-f6e5ca-openshift-default-dockercfg-9vhqf\""
Sep 08 15:13:56.828090 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.828067    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"]
Sep 08 15:13:56.968312 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-credential-socket\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-socket\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-certs\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmcwz\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-kube-api-access-zmcwz\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968437    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-envoy\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-data\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/094ae466-c18c-4d08-837e-4798baa731bb-istiod-ca-cert\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/094ae466-c18c-4d08-837e-4798baa731bb-istio-podinfo\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:56.968739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:56.968658    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-istio-token\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069478 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/094ae466-c18c-4d08-837e-4798baa731bb-istio-podinfo\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069627 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069492    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-istio-token\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069627 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-credential-socket\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069752 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069695    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-socket\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069752 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-certs\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069859 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmcwz\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-kube-api-access-zmcwz\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069859 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069797    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-envoy\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.069859 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-data\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.070011 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069854    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-credential-socket\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.070011 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.069907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/094ae466-c18c-4d08-837e-4798baa731bb-istiod-ca-cert\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.070121 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.070089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-socket\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.070201 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.070168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-data\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.070201 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.070189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-certs\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.070602 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.070583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/094ae466-c18c-4d08-837e-4798baa731bb-istiod-ca-cert\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.071963 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.071944    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-envoy\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.072147 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.072128    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/094ae466-c18c-4d08-837e-4798baa731bb-istio-podinfo\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.076785 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.076763    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-istio-token\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.076884 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.076812    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmcwz\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-kube-api-access-zmcwz\") pod \"e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") " pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.126949 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.126927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:57.404939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.404849    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"]
Sep 08 15:13:57.407635 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:13:57.407608    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod094ae466_c18c_4d08_837e_4798baa731bb.slice/crio-4b0f9c232844b934114e1cab8bab6680721b18712903c5d49f5055ba5642ea85 WatchSource:0}: Error finding container 4b0f9c232844b934114e1cab8bab6680721b18712903c5d49f5055ba5642ea85: Status 404 returned error can't find the container with id 4b0f9c232844b934114e1cab8bab6680721b18712903c5d49f5055ba5642ea85
Sep 08 15:13:57.410076 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.410032    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:57.410188 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.410118    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:57.410188 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.410174    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:13:57.859680 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.859580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" event={"ID":"094ae466-c18c-4d08-837e-4798baa731bb","Type":"ContainerStarted","Data":"598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"}
Sep 08 15:13:57.859680 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.859643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" event={"ID":"094ae466-c18c-4d08-837e-4798baa731bb","Type":"ContainerStarted","Data":"4b0f9c232844b934114e1cab8bab6680721b18712903c5d49f5055ba5642ea85"}
Sep 08 15:13:57.880638 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:57.880591    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podStartSLOduration=1.880576697 podStartE2EDuration="1.880576697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:57.878570435 +0000 UTC m=+1129.025591366" watchObservedRunningTime="2026-09-08 15:13:57.880576697 +0000 UTC m=+1129.027597604"
Sep 08 15:13:58.127996 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:58.127921    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:58.132565 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:58.132542    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:58.868164 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:58.868122    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:13:58.869110 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:13:58.869091    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:14:01.171598 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.171562    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"]
Sep 08 15:14:01.172056 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.172033    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="68ba853b-978a-411c-af71-c86a4ba9def9" containerName="istio-proxy"
Sep 08 15:14:01.174251 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.174228    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.180279 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.180256    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-f6e5ca-serving-cert\""
Sep 08 15:14:01.190264 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.190240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"]
Sep 08 15:14:01.207468 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.207429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.207581 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.207531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.207581 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.207553    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.207581 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.207577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t59xr\" (UniqueName: \"kubernetes.io/projected/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-kube-api-access-t59xr\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.308796 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.308770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.309004 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.308801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.309004 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.308824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t59xr\" (UniqueName: \"kubernetes.io/projected/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-kube-api-access-t59xr\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.309004 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.308910    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.309004 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:14:01.308934    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-serving-cert: secret "maas-api-e2e-shared-a-w2-f6e5ca-serving-cert" not found
Sep 08 15:14:01.309004 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:14:01.308995    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls podName:fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9 nodeName:}" failed. No retries permitted until 2026-09-08 15:14:01.80897616 +0000 UTC m=+1132.955997066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls") pod "maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" (UID: "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9") : secret "maas-api-e2e-shared-a-w2-f6e5ca-serving-cert" not found
Sep 08 15:14:01.309616 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.309593    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.311328 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.311304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.316950 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.316927    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t59xr\" (UniqueName: \"kubernetes.io/projected/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-kube-api-access-t59xr\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.813687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.813652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:01.815967 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:01.815943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:02.085522 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:02.085421    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:02.356725 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:02.356694    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"]
Sep 08 15:14:02.358286 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:14:02.358257    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5a8ca2_c9eb_4e56_8d0e_2def5be8cba9.slice/crio-39663b2f24ac76552f212a50b7935b9409875a2ffbac06439334d3a59212fb33 WatchSource:0}: Error finding container 39663b2f24ac76552f212a50b7935b9409875a2ffbac06439334d3a59212fb33: Status 404 returned error can't find the container with id 39663b2f24ac76552f212a50b7935b9409875a2ffbac06439334d3a59212fb33
Sep 08 15:14:02.891739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:02.891706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" event={"ID":"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9","Type":"ContainerStarted","Data":"39663b2f24ac76552f212a50b7935b9409875a2ffbac06439334d3a59212fb33"}
Sep 08 15:14:03.898895 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:03.898854    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" event={"ID":"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9","Type":"ContainerStarted","Data":"c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697"}
Sep 08 15:14:03.899553 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:03.898925    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:03.915707 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:03.915628    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" podStartSLOduration=2.094305436 podStartE2EDuration="2.915608907s" totalImagesPullingTime="821.303471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:03.915230983 +0000 UTC m=+1135.062251918" watchObservedRunningTime="2026-09-08 15:14:03.915608907 +0000 UTC m=+1135.062629814"
Sep 08 15:14:09.909771 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:09.909731    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:14:11.939833 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:11.939798    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"]
Sep 08 15:14:11.944025 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:11.944001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:11.947001 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:11.946974    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-7be222-serving-cert\""
Sep 08 15:14:11.957579 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:11.957462    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"]
Sep 08 15:14:12.015592 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.015564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46971275-5d56-4fc6-806c-0cbb1b3419dc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.015731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.015630    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.015731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.015685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.015731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.015715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tk7dt\" (UniqueName: \"kubernetes.io/projected/46971275-5d56-4fc6-806c-0cbb1b3419dc-kube-api-access-tk7dt\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.116845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.116810    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.116845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.116849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tk7dt\" (UniqueName: \"kubernetes.io/projected/46971275-5d56-4fc6-806c-0cbb1b3419dc-kube-api-access-tk7dt\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.117095 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.116905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46971275-5d56-4fc6-806c-0cbb1b3419dc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.117095 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.116961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.117786 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.117754    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46971275-5d56-4fc6-806c-0cbb1b3419dc-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.119437 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.119405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.119437 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.119409    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.124924 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.124903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tk7dt\" (UniqueName: \"kubernetes.io/projected/46971275-5d56-4fc6-806c-0cbb1b3419dc-kube-api-access-tk7dt\") pod \"maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.261490 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.261396    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:12.536474 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.536435    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"]
Sep 08 15:14:12.538442 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:14:12.538412    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46971275_5d56_4fc6_806c_0cbb1b3419dc.slice/crio-e3c5b6a6ab43784fcc2e64fcff03fd9edc5ba323028cc5b9a64d4cb43713b969 WatchSource:0}: Error finding container e3c5b6a6ab43784fcc2e64fcff03fd9edc5ba323028cc5b9a64d4cb43713b969: Status 404 returned error can't find the container with id e3c5b6a6ab43784fcc2e64fcff03fd9edc5ba323028cc5b9a64d4cb43713b969
Sep 08 15:14:12.958149 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.958117    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl" event={"ID":"46971275-5d56-4fc6-806c-0cbb1b3419dc","Type":"ContainerStarted","Data":"e3c5b6a6ab43784fcc2e64fcff03fd9edc5ba323028cc5b9a64d4cb43713b969"}
Sep 08 15:14:12.959790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.959760    2579 generic.go:356] "Generic (PLEG): container finished" podID="094ae466-c18c-4d08-837e-4798baa731bb" containerID="598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485" exitCode=0
Sep 08 15:14:12.959894 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.959824    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" event={"ID":"094ae466-c18c-4d08-837e-4798baa731bb","Type":"ContainerDied","Data":"598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"}
Sep 08 15:14:12.960203 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.960188    2579 scope.go:117] "RemoveContainer" containerID="598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"
Sep 08 15:14:12.961297 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.961262    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:12.961365 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.961346    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:12.961406 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:12.961392    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:14:13.874608 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:13.874557    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:14:13.974193 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:13.974157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" event={"ID":"094ae466-c18c-4d08-837e-4798baa731bb","Type":"ContainerStarted","Data":"a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716"}
Sep 08 15:14:13.976424 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:13.976400    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl" event={"ID":"46971275-5d56-4fc6-806c-0cbb1b3419dc","Type":"ContainerStarted","Data":"e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962"}
Sep 08 15:14:14.011017 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:14.010972    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl" podStartSLOduration=2.663931648 podStartE2EDuration="3.010958755s" totalImagesPullingTime="347.027107ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:14.00861246 +0000 UTC m=+1145.155633368" watchObservedRunningTime="2026-09-08 15:14:14.010958755 +0000 UTC m=+1145.157979661"
Sep 08 15:14:14.127917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:14.127841    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:14:14.128941 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:14.128918    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:14:14.129002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:14.128975    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 08 15:14:14.982510 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:14.982482    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:15.128226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:15.128185    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:14:15.128393 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:15.128269    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 08 15:14:16.128224 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:16.128193    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:14:16.128652 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:16.128552    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 08 15:14:17.127751 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:17.127718    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:14:17.127940 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:17.127779    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 08 15:14:18.127328 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:18.127293    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:14:18.127730 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:18.127348    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 08 15:14:19.131551 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:19.131521    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:14:19.131920 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:19.131777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:14:19.132505 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:19.132487    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:14:20.993773 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:20.993742    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:14:30.014210 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.014173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"]
Sep 08 15:14:30.018031 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.018003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.020172 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.020139    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-65dd51-serving-cert\""
Sep 08 15:14:30.030844 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.030808    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"]
Sep 08 15:14:30.077474 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.077422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pb49\" (UniqueName: \"kubernetes.io/projected/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-kube-api-access-9pb49\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.077602 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.077515    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.077602 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.077546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.077677 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.077618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.178308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.178275    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.178472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.178329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pb49\" (UniqueName: \"kubernetes.io/projected/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-kube-api-access-9pb49\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.178472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.178354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.178472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.178374    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.178644 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:14:30.178507    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-serving-cert: secret "maas-api-e2e-shared-b-w2-65dd51-serving-cert" not found
Sep 08 15:14:30.178644 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:14:30.178591    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls podName:22f20bbd-9862-4a09-bf6d-a2403f1db0c9 nodeName:}" failed. No retries permitted until 2026-09-08 15:14:30.67857151 +0000 UTC m=+1161.825592403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls") pod "maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" (UID: "22f20bbd-9862-4a09-bf6d-a2403f1db0c9") : secret "maas-api-e2e-shared-b-w2-65dd51-serving-cert" not found
Sep 08 15:14:30.179106 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.179087    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.180822 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.180797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.187891 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.187861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pb49\" (UniqueName: \"kubernetes.io/projected/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-kube-api-access-9pb49\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.683634 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.683589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.686331 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.686301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:30.931058 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:30.931026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:31.203839 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:31.203806    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"]
Sep 08 15:14:31.204814 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:14:31.204786    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f20bbd_9862_4a09_bf6d_a2403f1db0c9.slice/crio-ccb0deccee0a82c17a77c9fb18a29d9a33860546b654a7b9de7809f4f4821803 WatchSource:0}: Error finding container ccb0deccee0a82c17a77c9fb18a29d9a33860546b654a7b9de7809f4f4821803: Status 404 returned error can't find the container with id ccb0deccee0a82c17a77c9fb18a29d9a33860546b654a7b9de7809f4f4821803
Sep 08 15:14:32.090216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:32.090178    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" event={"ID":"22f20bbd-9862-4a09-bf6d-a2403f1db0c9","Type":"ContainerStarted","Data":"7e6c6841faae3fbbe9065edc7438943426dc408762d53a3203f7aa8b487134c2"}
Sep 08 15:14:32.090390 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:32.090268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" event={"ID":"22f20bbd-9862-4a09-bf6d-a2403f1db0c9","Type":"ContainerStarted","Data":"ccb0deccee0a82c17a77c9fb18a29d9a33860546b654a7b9de7809f4f4821803"}
Sep 08 15:14:32.090442 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:32.090389    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:14:32.114304 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:32.114256    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" podStartSLOduration=2.805904529 podStartE2EDuration="3.114242649s" totalImagesPullingTime="308.33812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:32.112764692 +0000 UTC m=+1163.259785594" watchObservedRunningTime="2026-09-08 15:14:32.114242649 +0000 UTC m=+1163.261263604"
Sep 08 15:14:38.102177 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:14:38.102148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:15:09.349391 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:09.349360    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:15:09.354803 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:09.354779    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:15:09.358587 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:09.358563    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:15:09.363819 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:09.363794    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:15:14.425202 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.425170    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"]
Sep 08 15:15:14.427932 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.427907    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.429980 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.429956    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-48dbdcd3-serving-cert\""
Sep 08 15:15:14.438165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.438146    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"]
Sep 08 15:15:14.590753 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.590716    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-maas-api-tls\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.590921 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.590793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-metrics-certs\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.590921 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.590843    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921d56f7-1598-48df-ae9e-02a133878ba2-openshift-service-ca\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.590921 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.590880    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp9ml\" (UniqueName: \"kubernetes.io/projected/921d56f7-1598-48df-ae9e-02a133878ba2-kube-api-access-kp9ml\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.692313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.692230    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-maas-api-tls\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.692313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.692266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-metrics-certs\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.692313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.692292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921d56f7-1598-48df-ae9e-02a133878ba2-openshift-service-ca\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.692614 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.692328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp9ml\" (UniqueName: \"kubernetes.io/projected/921d56f7-1598-48df-ae9e-02a133878ba2-kube-api-access-kp9ml\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.693049 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.693029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921d56f7-1598-48df-ae9e-02a133878ba2-openshift-service-ca\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.694673 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.694649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-maas-api-tls\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.694792 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.694779    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-metrics-certs\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.699601 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.699582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp9ml\" (UniqueName: \"kubernetes.io/projected/921d56f7-1598-48df-ae9e-02a133878ba2-kube-api-access-kp9ml\") pod \"maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:14.742156 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:14.742133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:15.024236 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:15.024212    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"]
Sep 08 15:15:15.025886 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:15:15.025858    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921d56f7_1598_48df_ae9e_02a133878ba2.slice/crio-8874eebaaa79e18e2ad7767f9b6a22d93c6a53bb7c834d15cc23aeea19ecfe6c WatchSource:0}: Error finding container 8874eebaaa79e18e2ad7767f9b6a22d93c6a53bb7c834d15cc23aeea19ecfe6c: Status 404 returned error can't find the container with id 8874eebaaa79e18e2ad7767f9b6a22d93c6a53bb7c834d15cc23aeea19ecfe6c
Sep 08 15:15:15.355231 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:15.355134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb" event={"ID":"921d56f7-1598-48df-ae9e-02a133878ba2","Type":"ContainerStarted","Data":"8874eebaaa79e18e2ad7767f9b6a22d93c6a53bb7c834d15cc23aeea19ecfe6c"}
Sep 08 15:15:16.362963 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:16.362884    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb" event={"ID":"921d56f7-1598-48df-ae9e-02a133878ba2","Type":"ContainerStarted","Data":"e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8"}
Sep 08 15:15:16.363307 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:16.362975    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:15:16.380917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:16.380864    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb" podStartSLOduration=1.31030292 podStartE2EDuration="2.380852457s" totalImagesPullingTime="1.070549537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:15:16.378157055 +0000 UTC m=+1207.525177960" watchObservedRunningTime="2026-09-08 15:15:16.380852457 +0000 UTC m=+1207.527873363"
Sep 08 15:15:22.374636 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:15:22.374601    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:16:38.024398 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.024354    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"]
Sep 08 15:16:38.025015 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.024582    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb" podUID="921d56f7-1598-48df-ae9e-02a133878ba2" containerName="maas-api" containerID="cri-o://e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8" gracePeriod=30
Sep 08 15:16:38.269500 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.269477    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:16:38.331758 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.331694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-maas-api-tls\") pod \"921d56f7-1598-48df-ae9e-02a133878ba2\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") "
Sep 08 15:16:38.331878 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.331809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-metrics-certs\") pod \"921d56f7-1598-48df-ae9e-02a133878ba2\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") "
Sep 08 15:16:38.331878 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.331850    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kp9ml\" (UniqueName: \"kubernetes.io/projected/921d56f7-1598-48df-ae9e-02a133878ba2-kube-api-access-kp9ml\") pod \"921d56f7-1598-48df-ae9e-02a133878ba2\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") "
Sep 08 15:16:38.331968 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.331948    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921d56f7-1598-48df-ae9e-02a133878ba2-openshift-service-ca\") pod \"921d56f7-1598-48df-ae9e-02a133878ba2\" (UID: \"921d56f7-1598-48df-ae9e-02a133878ba2\") "
Sep 08 15:16:38.332349 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.332314    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/921d56f7-1598-48df-ae9e-02a133878ba2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "921d56f7-1598-48df-ae9e-02a133878ba2" (UID: "921d56f7-1598-48df-ae9e-02a133878ba2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:16:38.333737 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.333711    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "921d56f7-1598-48df-ae9e-02a133878ba2" (UID: "921d56f7-1598-48df-ae9e-02a133878ba2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:16:38.333849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.333827    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "921d56f7-1598-48df-ae9e-02a133878ba2" (UID: "921d56f7-1598-48df-ae9e-02a133878ba2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:16:38.333849 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.333837    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921d56f7-1598-48df-ae9e-02a133878ba2-kube-api-access-kp9ml" (OuterVolumeSpecName: "kube-api-access-kp9ml") pod "921d56f7-1598-48df-ae9e-02a133878ba2" (UID: "921d56f7-1598-48df-ae9e-02a133878ba2"). InnerVolumeSpecName "kube-api-access-kp9ml". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:16:38.433117 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.433089    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:16:38.433117 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.433116    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/921d56f7-1598-48df-ae9e-02a133878ba2-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:16:38.433322 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.433125    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kp9ml\" (UniqueName: \"kubernetes.io/projected/921d56f7-1598-48df-ae9e-02a133878ba2-kube-api-access-kp9ml\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:16:38.433322 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.433137    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/921d56f7-1598-48df-ae9e-02a133878ba2-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:16:38.856900 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.856868    2579 generic.go:356] "Generic (PLEG): container finished" podID="921d56f7-1598-48df-ae9e-02a133878ba2" containerID="e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8" exitCode=0
Sep 08 15:16:38.857055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.856916    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"
Sep 08 15:16:38.857055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.856956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb" event={"ID":"921d56f7-1598-48df-ae9e-02a133878ba2","Type":"ContainerDied","Data":"e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8"}
Sep 08 15:16:38.857055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.857013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb" event={"ID":"921d56f7-1598-48df-ae9e-02a133878ba2","Type":"ContainerDied","Data":"8874eebaaa79e18e2ad7767f9b6a22d93c6a53bb7c834d15cc23aeea19ecfe6c"}
Sep 08 15:16:38.857055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.857043    2579 scope.go:117] "RemoveContainer" containerID="e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8"
Sep 08 15:16:38.867596 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.867541    2579 scope.go:117] "RemoveContainer" containerID="e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8"
Sep 08 15:16:38.867823 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:16:38.867804    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8\": container with ID starting with e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8 not found: ID does not exist" containerID="e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8"
Sep 08 15:16:38.867893 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.867833    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8"} err="failed to get container status \"e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8\": rpc error: code = NotFound desc = could not find container \"e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8\": container with ID starting with e008ea23248abc04410d100a5ac457296d58ad7715bbaf46765b8b4a2743def8 not found: ID does not exist"
Sep 08 15:16:38.880388 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.880364    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"]
Sep 08 15:16:38.884637 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:38.884616    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48dbdcd3-7c548c7cf6-g7cwb"]
Sep 08 15:16:39.390122 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:39.390075    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="921d56f7-1598-48df-ae9e-02a133878ba2" path="/var/lib/kubelet/pods/921d56f7-1598-48df-ae9e-02a133878ba2/volumes"
Sep 08 15:16:56.269034 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.268999    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7743-744ae8"]
Sep 08 15:16:56.269426 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.269413    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921d56f7-1598-48df-ae9e-02a133878ba2" containerName="maas-api"
Sep 08 15:16:56.269426 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.269427    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="921d56f7-1598-48df-ae9e-02a133878ba2" containerName="maas-api"
Sep 08 15:16:56.269542 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.269513    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="921d56f7-1598-48df-ae9e-02a133878ba2" containerName="maas-api"
Sep 08 15:16:56.272455 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.272428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:16:56.275129 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.275107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-sd75n\""
Sep 08 15:16:56.280618 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.280592    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-744ae8"]
Sep 08 15:16:56.389730 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.389707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khmdl\" (UniqueName: \"kubernetes.io/projected/965411e4-1100-4e2b-a7ef-df78ac0fbeb4-kube-api-access-khmdl\") pod \"mt-curl-7743-744ae8\" (UID: \"965411e4-1100-4e2b-a7ef-df78ac0fbeb4\") " pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:16:56.490976 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.490950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khmdl\" (UniqueName: \"kubernetes.io/projected/965411e4-1100-4e2b-a7ef-df78ac0fbeb4-kube-api-access-khmdl\") pod \"mt-curl-7743-744ae8\" (UID: \"965411e4-1100-4e2b-a7ef-df78ac0fbeb4\") " pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:16:56.502300 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.502274    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khmdl\" (UniqueName: \"kubernetes.io/projected/965411e4-1100-4e2b-a7ef-df78ac0fbeb4-kube-api-access-khmdl\") pod \"mt-curl-7743-744ae8\" (UID: \"965411e4-1100-4e2b-a7ef-df78ac0fbeb4\") " pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:16:56.582093 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.582038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:16:56.850794 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.850771    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7743-744ae8"]
Sep 08 15:16:56.853626 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:16:56.853596    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod965411e4_1100_4e2b_a7ef_df78ac0fbeb4.slice/crio-de74ef801d8795aecee380ca258f64d7cee885b690ca08d0e4b2920305fcbe2a WatchSource:0}: Error finding container de74ef801d8795aecee380ca258f64d7cee885b690ca08d0e4b2920305fcbe2a: Status 404 returned error can't find the container with id de74ef801d8795aecee380ca258f64d7cee885b690ca08d0e4b2920305fcbe2a
Sep 08 15:16:56.854947 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.854928    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:16:56.967573 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:56.967543    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-744ae8" event={"ID":"965411e4-1100-4e2b-a7ef-df78ac0fbeb4","Type":"ContainerStarted","Data":"de74ef801d8795aecee380ca258f64d7cee885b690ca08d0e4b2920305fcbe2a"}
Sep 08 15:16:57.974704 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:57.974672    2579 generic.go:356] "Generic (PLEG): container finished" podID="965411e4-1100-4e2b-a7ef-df78ac0fbeb4" containerID="e36b052c503ff7cc950b5af16d060f1f15c8d2f9ce23c4d9e6e3ad0314671146" exitCode=0
Sep 08 15:16:57.975023 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:57.974733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7743-744ae8" event={"ID":"965411e4-1100-4e2b-a7ef-df78ac0fbeb4","Type":"ContainerDied","Data":"e36b052c503ff7cc950b5af16d060f1f15c8d2f9ce23c4d9e6e3ad0314671146"}
Sep 08 15:16:59.119937 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.119912    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:16:59.160619 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.160593    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7743-744ae8_965411e4-1100-4e2b-a7ef-df78ac0fbeb4/mt-curl-7743-744ae8/0.log"
Sep 08 15:16:59.184376 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.184351    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7743-744ae8"]
Sep 08 15:16:59.191015 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.190993    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7743-744ae8"]
Sep 08 15:16:59.216790 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.216766    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khmdl\" (UniqueName: \"kubernetes.io/projected/965411e4-1100-4e2b-a7ef-df78ac0fbeb4-kube-api-access-khmdl\") pod \"965411e4-1100-4e2b-a7ef-df78ac0fbeb4\" (UID: \"965411e4-1100-4e2b-a7ef-df78ac0fbeb4\") "
Sep 08 15:16:59.218951 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.218930    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/965411e4-1100-4e2b-a7ef-df78ac0fbeb4-kube-api-access-khmdl" (OuterVolumeSpecName: "kube-api-access-khmdl") pod "965411e4-1100-4e2b-a7ef-df78ac0fbeb4" (UID: "965411e4-1100-4e2b-a7ef-df78ac0fbeb4"). InnerVolumeSpecName "kube-api-access-khmdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:16:59.318405 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.318323    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khmdl\" (UniqueName: \"kubernetes.io/projected/965411e4-1100-4e2b-a7ef-df78ac0fbeb4-kube-api-access-khmdl\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:16:59.389922 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.389889    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="965411e4-1100-4e2b-a7ef-df78ac0fbeb4" path="/var/lib/kubelet/pods/965411e4-1100-4e2b-a7ef-df78ac0fbeb4/volumes"
Sep 08 15:16:59.988573 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.988548    2579 scope.go:117] "RemoveContainer" containerID="e36b052c503ff7cc950b5af16d060f1f15c8d2f9ce23c4d9e6e3ad0314671146"
Sep 08 15:16:59.988737 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:16:59.988574    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7743-744ae8"
Sep 08 15:18:31.094522 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.094485    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"]
Sep 08 15:18:31.094972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.094911    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965411e4-1100-4e2b-a7ef-df78ac0fbeb4" containerName="mt-curl-7743-744ae8"
Sep 08 15:18:31.094972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.094922    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="965411e4-1100-4e2b-a7ef-df78ac0fbeb4" containerName="mt-curl-7743-744ae8"
Sep 08 15:18:31.095050 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.094996    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="965411e4-1100-4e2b-a7ef-df78ac0fbeb4" containerName="mt-curl-7743-744ae8"
Sep 08 15:18:31.098314 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.098287    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.101222 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.101202    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-3ccde3-serving-cert\""
Sep 08 15:18:31.111608 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.111588    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"]
Sep 08 15:18:31.204838 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.204810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-maas-api-tls\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.204995 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.204852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-metrics-certs\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.204995 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.204961    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d114ae-8112-4b1f-9d17-f30b8d919daf-openshift-service-ca\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.205086 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.205053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7bv\" (UniqueName: \"kubernetes.io/projected/39d114ae-8112-4b1f-9d17-f30b8d919daf-kube-api-access-kz7bv\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.305944 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.305916    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d114ae-8112-4b1f-9d17-f30b8d919daf-openshift-service-ca\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.306073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.305966    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7bv\" (UniqueName: \"kubernetes.io/projected/39d114ae-8112-4b1f-9d17-f30b8d919daf-kube-api-access-kz7bv\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.306073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.305996    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-maas-api-tls\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.306073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.306018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-metrics-certs\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.306571 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.306543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d114ae-8112-4b1f-9d17-f30b8d919daf-openshift-service-ca\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.308523 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.308499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-metrics-certs\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.308655 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.308557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-maas-api-tls\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.313723 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.313702    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7bv\" (UniqueName: \"kubernetes.io/projected/39d114ae-8112-4b1f-9d17-f30b8d919daf-kube-api-access-kz7bv\") pod \"maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.408618 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.408596    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:31.682720 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:31.682693    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"]
Sep 08 15:18:31.684484 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:18:31.684440    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d114ae_8112_4b1f_9d17_f30b8d919daf.slice/crio-6a2facb38177a0468aa3e618ac61ae961e1e7a1366240f10da93e6c06760a0a5 WatchSource:0}: Error finding container 6a2facb38177a0468aa3e618ac61ae961e1e7a1366240f10da93e6c06760a0a5: Status 404 returned error can't find the container with id 6a2facb38177a0468aa3e618ac61ae961e1e7a1366240f10da93e6c06760a0a5
Sep 08 15:18:32.532807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:32.532765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z" event={"ID":"39d114ae-8112-4b1f-9d17-f30b8d919daf","Type":"ContainerStarted","Data":"6a2facb38177a0468aa3e618ac61ae961e1e7a1366240f10da93e6c06760a0a5"}
Sep 08 15:18:33.540525 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:33.540484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z" event={"ID":"39d114ae-8112-4b1f-9d17-f30b8d919daf","Type":"ContainerStarted","Data":"c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b"}
Sep 08 15:18:33.540970 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:33.540549    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:33.560477 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:33.560418    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z" podStartSLOduration=1.5376101389999999 podStartE2EDuration="2.56040178s" totalImagesPullingTime="1.022791641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:33.557078487 +0000 UTC m=+1404.704099397" watchObservedRunningTime="2026-09-08 15:18:33.56040178 +0000 UTC m=+1404.707422709"
Sep 08 15:18:39.553282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:39.553252    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:18:59.846299 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.846264    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"]
Sep 08 15:18:59.849748 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.849726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.851887 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.851859    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0da0d1-serving-cert\""
Sep 08 15:18:59.860465 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.858418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-openshift-service-ca\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.860465 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.858533    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.860465 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.858622    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-metrics-certs\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.860465 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.858673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz7mg\" (UniqueName: \"kubernetes.io/projected/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-kube-api-access-fz7mg\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.868117 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.867901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"]
Sep 08 15:18:59.959313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.959257    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz7mg\" (UniqueName: \"kubernetes.io/projected/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-kube-api-access-fz7mg\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.959554 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.959371    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-openshift-service-ca\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.959554 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.959422    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.959554 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.959525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-metrics-certs\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.959881 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:18:59.959851    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-serving-cert: secret "maas-api-e2e-api-b-0da0d1-serving-cert" not found
Sep 08 15:18:59.960031 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:18:59.959941    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls podName:8a5d91cc-0963-4c53-83f3-fd5ca3230afc nodeName:}" failed. No retries permitted until 2026-09-08 15:19:00.459919298 +0000 UTC m=+1431.606940206 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls") pod "maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" (UID: "8a5d91cc-0963-4c53-83f3-fd5ca3230afc") : secret "maas-api-e2e-api-b-0da0d1-serving-cert" not found
Sep 08 15:18:59.960499 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.960384    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-openshift-service-ca\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.962775 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.962747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-metrics-certs\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:18:59.972578 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:18:59.972557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz7mg\" (UniqueName: \"kubernetes.io/projected/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-kube-api-access-fz7mg\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:19:00.463427 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:00.463385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:19:00.465755 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:00.465732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls\") pod \"maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:19:00.474600 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:00.474580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:19:00.750777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:00.750749    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"]
Sep 08 15:19:00.754169 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:19:00.754142    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a5d91cc_0963_4c53_83f3_fd5ca3230afc.slice/crio-bb66cf7cf0db14932a1280eb7c163b6bd6e3dab3ec6c22aeaf1a29d7e04ee7f5 WatchSource:0}: Error finding container bb66cf7cf0db14932a1280eb7c163b6bd6e3dab3ec6c22aeaf1a29d7e04ee7f5: Status 404 returned error can't find the container with id bb66cf7cf0db14932a1280eb7c163b6bd6e3dab3ec6c22aeaf1a29d7e04ee7f5
Sep 08 15:19:01.711898 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:01.711867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" event={"ID":"8a5d91cc-0963-4c53-83f3-fd5ca3230afc","Type":"ContainerStarted","Data":"85921bb64f8f4e3b042d415947b1a6776516f84170e68a0868447fd91af0de32"}
Sep 08 15:19:01.712265 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:01.711912    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" event={"ID":"8a5d91cc-0963-4c53-83f3-fd5ca3230afc","Type":"ContainerStarted","Data":"bb66cf7cf0db14932a1280eb7c163b6bd6e3dab3ec6c22aeaf1a29d7e04ee7f5"}
Sep 08 15:19:01.712265 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:01.711965    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:19:01.728385 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:01.728345    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" podStartSLOduration=2.28702471 podStartE2EDuration="2.728332595s" totalImagesPullingTime="441.307885ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:01.727129617 +0000 UTC m=+1432.874150525" watchObservedRunningTime="2026-09-08 15:19:01.728332595 +0000 UTC m=+1432.875353501"
Sep 08 15:19:07.723671 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:07.723641    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:19:42.389177 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.389145    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"]
Sep 08 15:19:42.391203 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.389328    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z" podUID="39d114ae-8112-4b1f-9d17-f30b8d919daf" containerName="maas-api" containerID="cri-o://c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b" gracePeriod=30
Sep 08 15:19:42.643433 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.643411    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:19:42.739387 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.739359    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d114ae-8112-4b1f-9d17-f30b8d919daf-openshift-service-ca\") pod \"39d114ae-8112-4b1f-9d17-f30b8d919daf\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") "
Sep 08 15:19:42.739387 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.739390    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz7bv\" (UniqueName: \"kubernetes.io/projected/39d114ae-8112-4b1f-9d17-f30b8d919daf-kube-api-access-kz7bv\") pod \"39d114ae-8112-4b1f-9d17-f30b8d919daf\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") "
Sep 08 15:19:42.739586 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.739466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-maas-api-tls\") pod \"39d114ae-8112-4b1f-9d17-f30b8d919daf\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") "
Sep 08 15:19:42.739586 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.739558    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-metrics-certs\") pod \"39d114ae-8112-4b1f-9d17-f30b8d919daf\" (UID: \"39d114ae-8112-4b1f-9d17-f30b8d919daf\") "
Sep 08 15:19:42.739845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.739815    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d114ae-8112-4b1f-9d17-f30b8d919daf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "39d114ae-8112-4b1f-9d17-f30b8d919daf" (UID: "39d114ae-8112-4b1f-9d17-f30b8d919daf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:19:42.739978 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.739956    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d114ae-8112-4b1f-9d17-f30b8d919daf-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:19:42.741661 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.741626    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "39d114ae-8112-4b1f-9d17-f30b8d919daf" (UID: "39d114ae-8112-4b1f-9d17-f30b8d919daf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:42.742052 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.742025    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "39d114ae-8112-4b1f-9d17-f30b8d919daf" (UID: "39d114ae-8112-4b1f-9d17-f30b8d919daf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:19:42.742135 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.742025    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39d114ae-8112-4b1f-9d17-f30b8d919daf-kube-api-access-kz7bv" (OuterVolumeSpecName: "kube-api-access-kz7bv") pod "39d114ae-8112-4b1f-9d17-f30b8d919daf" (UID: "39d114ae-8112-4b1f-9d17-f30b8d919daf"). InnerVolumeSpecName "kube-api-access-kz7bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:42.841242 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.841203    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz7bv\" (UniqueName: \"kubernetes.io/projected/39d114ae-8112-4b1f-9d17-f30b8d919daf-kube-api-access-kz7bv\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:19:42.841242 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.841235    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:19:42.841242 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.841250    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/39d114ae-8112-4b1f-9d17-f30b8d919daf-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:19:42.961257 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.961173    2579 generic.go:356] "Generic (PLEG): container finished" podID="39d114ae-8112-4b1f-9d17-f30b8d919daf" containerID="c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b" exitCode=0
Sep 08 15:19:42.961257 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.961215    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"
Sep 08 15:19:42.961515 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.961256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z" event={"ID":"39d114ae-8112-4b1f-9d17-f30b8d919daf","Type":"ContainerDied","Data":"c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b"}
Sep 08 15:19:42.961515 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.961312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z" event={"ID":"39d114ae-8112-4b1f-9d17-f30b8d919daf","Type":"ContainerDied","Data":"6a2facb38177a0468aa3e618ac61ae961e1e7a1366240f10da93e6c06760a0a5"}
Sep 08 15:19:42.961515 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.961335    2579 scope.go:117] "RemoveContainer" containerID="c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b"
Sep 08 15:19:42.972009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.971994    2579 scope.go:117] "RemoveContainer" containerID="c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b"
Sep 08 15:19:42.972260 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:19:42.972244    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b\": container with ID starting with c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b not found: ID does not exist" containerID="c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b"
Sep 08 15:19:42.972306 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.972267    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b"} err="failed to get container status \"c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b\": rpc error: code = NotFound desc = could not find container \"c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b\": container with ID starting with c64b9fab51eb88cb65adcc6d563daccf88c3385e6c45111bfaf726b4423ac09b not found: ID does not exist"
Sep 08 15:19:42.984752 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.984728    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"]
Sep 08 15:19:42.991141 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:42.991121    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-3ccde3-7bcb4cb4f8-q7x7z"]
Sep 08 15:19:43.388829 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:19:43.388754    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d114ae-8112-4b1f-9d17-f30b8d919daf" path="/var/lib/kubelet/pods/39d114ae-8112-4b1f-9d17-f30b8d919daf/volumes"
Sep 08 15:20:05.853336 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:05.853297    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"]
Sep 08 15:20:05.853812 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:05.853549    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" podUID="8a5d91cc-0963-4c53-83f3-fd5ca3230afc" containerName="maas-api" containerID="cri-o://85921bb64f8f4e3b042d415947b1a6776516f84170e68a0868447fd91af0de32" gracePeriod=30
Sep 08 15:20:06.110894 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.110822    2579 generic.go:356] "Generic (PLEG): container finished" podID="8a5d91cc-0963-4c53-83f3-fd5ca3230afc" containerID="85921bb64f8f4e3b042d415947b1a6776516f84170e68a0868447fd91af0de32" exitCode=0
Sep 08 15:20:06.111216 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.110937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" event={"ID":"8a5d91cc-0963-4c53-83f3-fd5ca3230afc","Type":"ContainerDied","Data":"85921bb64f8f4e3b042d415947b1a6776516f84170e68a0868447fd91af0de32"}
Sep 08 15:20:06.111530 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.111503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv" event={"ID":"8a5d91cc-0963-4c53-83f3-fd5ca3230afc","Type":"ContainerDied","Data":"bb66cf7cf0db14932a1280eb7c163b6bd6e3dab3ec6c22aeaf1a29d7e04ee7f5"}
Sep 08 15:20:06.111676 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.111660    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb66cf7cf0db14932a1280eb7c163b6bd6e3dab3ec6c22aeaf1a29d7e04ee7f5"
Sep 08 15:20:06.118235 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.118215    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:20:06.245788 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.245761    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls\") pod \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") "
Sep 08 15:20:06.245972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.245809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-metrics-certs\") pod \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") "
Sep 08 15:20:06.245972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.245850    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz7mg\" (UniqueName: \"kubernetes.io/projected/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-kube-api-access-fz7mg\") pod \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") "
Sep 08 15:20:06.245972 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.245920    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-openshift-service-ca\") pod \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\" (UID: \"8a5d91cc-0963-4c53-83f3-fd5ca3230afc\") "
Sep 08 15:20:06.246402 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.246367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a5d91cc-0963-4c53-83f3-fd5ca3230afc" (UID: "8a5d91cc-0963-4c53-83f3-fd5ca3230afc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:06.248000 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.247973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8a5d91cc-0963-4c53-83f3-fd5ca3230afc" (UID: "8a5d91cc-0963-4c53-83f3-fd5ca3230afc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:06.248200 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.248176    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-kube-api-access-fz7mg" (OuterVolumeSpecName: "kube-api-access-fz7mg") pod "8a5d91cc-0963-4c53-83f3-fd5ca3230afc" (UID: "8a5d91cc-0963-4c53-83f3-fd5ca3230afc"). InnerVolumeSpecName "kube-api-access-fz7mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:06.248292 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.248272    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a5d91cc-0963-4c53-83f3-fd5ca3230afc" (UID: "8a5d91cc-0963-4c53-83f3-fd5ca3230afc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:06.346967 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.346933    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:06.346967 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.346966    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:06.347136 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.346981    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:06.347136 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:06.346992    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz7mg\" (UniqueName: \"kubernetes.io/projected/8a5d91cc-0963-4c53-83f3-fd5ca3230afc-kube-api-access-fz7mg\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:07.117493 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:07.117444    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"
Sep 08 15:20:07.140412 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:07.140387    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"]
Sep 08 15:20:07.144649 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:07.144618    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0da0d1-56945fb6f4-52qgv"]
Sep 08 15:20:07.388545 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:07.388442    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5d91cc-0963-4c53-83f3-fd5ca3230afc" path="/var/lib/kubelet/pods/8a5d91cc-0963-4c53-83f3-fd5ca3230afc/volumes"
Sep 08 15:20:09.392271 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:09.392238    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:20:09.397043 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:09.397018    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:20:09.402736 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:09.402717    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:20:09.407201 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:09.407179    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:20:23.814728 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:23.814691    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"]
Sep 08 15:20:23.815312 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:23.814955    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" podUID="fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" containerName="maas-api" containerID="cri-o://c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697" gracePeriod=30
Sep 08 15:20:24.067346 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.067285    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:20:24.217262 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.217229    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls\") pod \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") "
Sep 08 15:20:24.217410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.217310    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t59xr\" (UniqueName: \"kubernetes.io/projected/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-kube-api-access-t59xr\") pod \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") "
Sep 08 15:20:24.217410 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.217405    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-metrics-certs\") pod \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") "
Sep 08 15:20:24.217567 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.217515    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-openshift-service-ca\") pod \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\" (UID: \"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9\") "
Sep 08 15:20:24.218009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.217948    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" (UID: "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:24.219791 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.219734    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" (UID: "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:24.220086 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.220061    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" (UID: "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:24.220086 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.220067    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-kube-api-access-t59xr" (OuterVolumeSpecName: "kube-api-access-t59xr") pod "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" (UID: "fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9"). InnerVolumeSpecName "kube-api-access-t59xr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:24.221712 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.221684    2579 generic.go:356] "Generic (PLEG): container finished" podID="fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" containerID="c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697" exitCode=0
Sep 08 15:20:24.221829 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.221730    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"
Sep 08 15:20:24.221829 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.221779    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" event={"ID":"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9","Type":"ContainerDied","Data":"c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697"}
Sep 08 15:20:24.221942 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.221831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n" event={"ID":"fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9","Type":"ContainerDied","Data":"39663b2f24ac76552f212a50b7935b9409875a2ffbac06439334d3a59212fb33"}
Sep 08 15:20:24.221942 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.221858    2579 scope.go:117] "RemoveContainer" containerID="c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697"
Sep 08 15:20:24.244495 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.244473    2579 scope.go:117] "RemoveContainer" containerID="c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697"
Sep 08 15:20:24.244926 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:24.244900    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697\": container with ID starting with c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697 not found: ID does not exist" containerID="c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697"
Sep 08 15:20:24.245041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.244937    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697"} err="failed to get container status \"c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697\": rpc error: code = NotFound desc = could not find container \"c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697\": container with ID starting with c583c0a5ea1f3c1f11a8350b79164edf766a3f611fd960378bb85f12c375b697 not found: ID does not exist"
Sep 08 15:20:24.258155 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.258132    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"]
Sep 08 15:20:24.261405 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.261383    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-f6e5ca-5f7f4797c8-ltc8n"]
Sep 08 15:20:24.318687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.318637    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.318687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.318656    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.318687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.318665    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:24.318687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:24.318676    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t59xr\" (UniqueName: \"kubernetes.io/projected/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9-kube-api-access-t59xr\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:25.389504 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:25.389467    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" path="/var/lib/kubelet/pods/fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9/volumes"
Sep 08 15:20:30.372069 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372031    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"]
Sep 08 15:20:30.372635 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372617    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5d91cc-0963-4c53-83f3-fd5ca3230afc" containerName="maas-api"
Sep 08 15:20:30.372691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372638    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5d91cc-0963-4c53-83f3-fd5ca3230afc" containerName="maas-api"
Sep 08 15:20:30.372691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372650    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d114ae-8112-4b1f-9d17-f30b8d919daf" containerName="maas-api"
Sep 08 15:20:30.372691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372656    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d114ae-8112-4b1f-9d17-f30b8d919daf" containerName="maas-api"
Sep 08 15:20:30.372691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372676    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" containerName="maas-api"
Sep 08 15:20:30.372691 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372682    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" containerName="maas-api"
Sep 08 15:20:30.372850 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372764    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d114ae-8112-4b1f-9d17-f30b8d919daf" containerName="maas-api"
Sep 08 15:20:30.372850 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372773    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5d91cc-0963-4c53-83f3-fd5ca3230afc" containerName="maas-api"
Sep 08 15:20:30.372850 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.372785    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb5a8ca2-c9eb-4e56-8d0e-2def5be8cba9" containerName="maas-api"
Sep 08 15:20:30.377165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.377146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.379608 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.379589    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-bdd5c7-serving-cert\""
Sep 08 15:20:30.388592 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.388568    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"]
Sep 08 15:20:30.475017 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.474993    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.475158 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.475036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-872v9\" (UniqueName: \"kubernetes.io/projected/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-kube-api-access-872v9\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.475158 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.475106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.475235 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.475175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-metrics-certs\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.575943 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.575915    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-metrics-certs\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.576089 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.575981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.576089 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.576015    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-872v9\" (UniqueName: \"kubernetes.io/projected/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-kube-api-access-872v9\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.576089 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.576036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.576200 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:30.576133    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-serving-cert: secret "maas-api-e2e-ipp-a-bdd5c7-serving-cert" not found
Sep 08 15:20:30.576200 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:30.576199    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls podName:d2a21ea8-0dd9-47bb-a2fc-055d6fae6956 nodeName:}" failed. No retries permitted until 2026-09-08 15:20:31.076182814 +0000 UTC m=+1522.223203698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls") pod "maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" (UID: "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956") : secret "maas-api-e2e-ipp-a-bdd5c7-serving-cert" not found
Sep 08 15:20:30.576724 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.576698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.578415 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.578391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-metrics-certs\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.584323 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.584301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-872v9\" (UniqueName: \"kubernetes.io/projected/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-kube-api-access-872v9\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:30.900826 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.900792    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"]
Sep 08 15:20:30.901058 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:30.901009    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" containerID="cri-o://a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716" gracePeriod=30
Sep 08 15:20:31.081260 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:31.081228    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:31.083681 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:31.083652    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls\") pod \"maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:31.289259 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:31.289185    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:31.576317 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:31.576285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"]
Sep 08 15:20:31.577517 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:20:31.577492    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2a21ea8_0dd9_47bb_a2fc_055d6fae6956.slice/crio-72780b9702b6b28c2217c7ad6074db525ae7a450d7ac2541455bae3be9bca685 WatchSource:0}: Error finding container 72780b9702b6b28c2217c7ad6074db525ae7a450d7ac2541455bae3be9bca685: Status 404 returned error can't find the container with id 72780b9702b6b28c2217c7ad6074db525ae7a450d7ac2541455bae3be9bca685
Sep 08 15:20:32.275782 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:32.275753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" event={"ID":"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956","Type":"ContainerStarted","Data":"b6e00720ae79d87c28945ce4a941b0ef8ad4545da35b1583c261bbf83a83f3f4"}
Sep 08 15:20:32.275924 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:32.275808    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" event={"ID":"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956","Type":"ContainerStarted","Data":"72780b9702b6b28c2217c7ad6074db525ae7a450d7ac2541455bae3be9bca685"}
Sep 08 15:20:32.275924 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:32.275835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:32.296401 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:32.296354    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" podStartSLOduration=1.7898964 podStartE2EDuration="2.296340321s" totalImagesPullingTime="506.443921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:32.294546479 +0000 UTC m=+1523.441567388" watchObservedRunningTime="2026-09-08 15:20:32.296340321 +0000 UTC m=+1523.443361229"
Sep 08 15:20:34.134300 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:34.134260    2579 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:20:34.134739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:34.134331    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:20:36.149632 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.149609    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:20:36.229743 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229685    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-envoy\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.229743 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-data\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.229917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229766    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-istio-token\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.229917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-certs\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.229917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229835    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-credential-socket\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.229917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229868    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/094ae466-c18c-4d08-837e-4798baa731bb-istio-podinfo\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.229917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/094ae466-c18c-4d08-837e-4798baa731bb-istiod-ca-cert\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.230161 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229968    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-socket\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.230161 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229991    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmcwz\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-kube-api-access-zmcwz\") pod \"094ae466-c18c-4d08-837e-4798baa731bb\" (UID: \"094ae466-c18c-4d08-837e-4798baa731bb\") "
Sep 08 15:20:36.230161 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.229990    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:36.230317 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.230273    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.230317 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.230288    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:36.230432 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.230380    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/094ae466-c18c-4d08-837e-4798baa731bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:36.230500 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.230392    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:36.230500 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.230485    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:36.232300 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.232276    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-kube-api-access-zmcwz" (OuterVolumeSpecName: "kube-api-access-zmcwz") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "kube-api-access-zmcwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:36.232396 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.232315    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/094ae466-c18c-4d08-837e-4798baa731bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:20:36.232511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.232495    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:36.232562 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.232518    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "094ae466-c18c-4d08-837e-4798baa731bb" (UID: "094ae466-c18c-4d08-837e-4798baa731bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:20:36.301507 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.301482    2579 generic.go:356] "Generic (PLEG): container finished" podID="094ae466-c18c-4d08-837e-4798baa731bb" containerID="a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716" exitCode=0
Sep 08 15:20:36.301615 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.301525    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" event={"ID":"094ae466-c18c-4d08-837e-4798baa731bb","Type":"ContainerDied","Data":"a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716"}
Sep 08 15:20:36.301615 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.301537    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"
Sep 08 15:20:36.301615 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.301568    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42" event={"ID":"094ae466-c18c-4d08-837e-4798baa731bb","Type":"ContainerDied","Data":"4b0f9c232844b934114e1cab8bab6680721b18712903c5d49f5055ba5642ea85"}
Sep 08 15:20:36.301615 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.301589    2579 scope.go:117] "RemoveContainer" containerID="a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716"
Sep 08 15:20:36.310905 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.310885    2579 scope.go:117] "RemoveContainer" containerID="598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"
Sep 08 15:20:36.319739 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.319716    2579 scope.go:117] "RemoveContainer" containerID="a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716"
Sep 08 15:20:36.319998 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:36.319979    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716\": container with ID starting with a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716 not found: ID does not exist" containerID="a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716"
Sep 08 15:20:36.320037 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.320006    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716"} err="failed to get container status \"a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716\": rpc error: code = NotFound desc = could not find container \"a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716\": container with ID starting with a9d1c1beb97c716cec7d0eb85ed82f3ce5bd2bcff1e9be230d8d21fd84ffa716 not found: ID does not exist"
Sep 08 15:20:36.320037 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.320022    2579 scope.go:117] "RemoveContainer" containerID="598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"
Sep 08 15:20:36.320274 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:36.320259    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485\": container with ID starting with 598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485 not found: ID does not exist" containerID="598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"
Sep 08 15:20:36.320313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.320281    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485"} err="failed to get container status \"598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485\": rpc error: code = NotFound desc = could not find container \"598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485\": container with ID starting with 598bff5e24e67c4587dce03f40148ff0a63295f76a138260b4b9512098cb7485 not found: ID does not exist"
Sep 08 15:20:36.324593 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.324574    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"]
Sep 08 15:20:36.328472 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.328437    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f6e5ca-openshift-default-57b6c754f4-nqh42"]
Sep 08 15:20:36.331386 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331364    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331388    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/094ae466-c18c-4d08-837e-4798baa731bb-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331402    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/094ae466-c18c-4d08-837e-4798baa731bb-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331414    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331426    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmcwz\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-kube-api-access-zmcwz\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331439    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331478    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/094ae466-c18c-4d08-837e-4798baa731bb-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:36.331503 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:36.331492    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/094ae466-c18c-4d08-837e-4798baa731bb-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:37.388709 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:37.388678    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="094ae466-c18c-4d08-837e-4798baa731bb" path="/var/lib/kubelet/pods/094ae466-c18c-4d08-837e-4798baa731bb/volumes"
Sep 08 15:20:38.287991 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:38.287966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:20:42.157426 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.157391    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"]
Sep 08 15:20:42.157887 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.157666    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" podUID="22f20bbd-9862-4a09-bf6d-a2403f1db0c9" containerName="maas-api" containerID="cri-o://7e6c6841faae3fbbe9065edc7438943426dc408762d53a3203f7aa8b487134c2" gracePeriod=30
Sep 08 15:20:42.342269 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.342239    2579 generic.go:356] "Generic (PLEG): container finished" podID="22f20bbd-9862-4a09-bf6d-a2403f1db0c9" containerID="7e6c6841faae3fbbe9065edc7438943426dc408762d53a3203f7aa8b487134c2" exitCode=0
Sep 08 15:20:42.342401 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.342355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" event={"ID":"22f20bbd-9862-4a09-bf6d-a2403f1db0c9","Type":"ContainerDied","Data":"7e6c6841faae3fbbe9065edc7438943426dc408762d53a3203f7aa8b487134c2"}
Sep 08 15:20:42.406095 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.406073    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:20:42.483309 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.483220    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pb49\" (UniqueName: \"kubernetes.io/projected/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-kube-api-access-9pb49\") pod \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") "
Sep 08 15:20:42.483496 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.483313    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-openshift-service-ca\") pod \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") "
Sep 08 15:20:42.483583 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.483493    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls\") pod \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") "
Sep 08 15:20:42.483583 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.483556    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-metrics-certs\") pod \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\" (UID: \"22f20bbd-9862-4a09-bf6d-a2403f1db0c9\") "
Sep 08 15:20:42.483734 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.483691    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22f20bbd-9862-4a09-bf6d-a2403f1db0c9" (UID: "22f20bbd-9862-4a09-bf6d-a2403f1db0c9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:20:42.483938 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.483917    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:42.485538 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.485514    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "22f20bbd-9862-4a09-bf6d-a2403f1db0c9" (UID: "22f20bbd-9862-4a09-bf6d-a2403f1db0c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:42.485646 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.485603    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-kube-api-access-9pb49" (OuterVolumeSpecName: "kube-api-access-9pb49") pod "22f20bbd-9862-4a09-bf6d-a2403f1db0c9" (UID: "22f20bbd-9862-4a09-bf6d-a2403f1db0c9"). InnerVolumeSpecName "kube-api-access-9pb49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:20:42.485910 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.485895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22f20bbd-9862-4a09-bf6d-a2403f1db0c9" (UID: "22f20bbd-9862-4a09-bf6d-a2403f1db0c9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:20:42.585263 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.585231    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:42.585263 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.585255    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:42.585263 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:42.585265    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pb49\" (UniqueName: \"kubernetes.io/projected/22f20bbd-9862-4a09-bf6d-a2403f1db0c9-kube-api-access-9pb49\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:20:43.350106 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:43.350068    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"
Sep 08 15:20:43.350565 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:43.350100    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9" event={"ID":"22f20bbd-9862-4a09-bf6d-a2403f1db0c9","Type":"ContainerDied","Data":"ccb0deccee0a82c17a77c9fb18a29d9a33860546b654a7b9de7809f4f4821803"}
Sep 08 15:20:43.350565 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:43.350168    2579 scope.go:117] "RemoveContainer" containerID="7e6c6841faae3fbbe9065edc7438943426dc408762d53a3203f7aa8b487134c2"
Sep 08 15:20:43.372857 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:43.372831    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"]
Sep 08 15:20:43.376511 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:43.376488    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-65dd51-7dbffcdf58-984k9"]
Sep 08 15:20:43.388640 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:43.388617    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f20bbd-9862-4a09-bf6d-a2403f1db0c9" path="/var/lib/kubelet/pods/22f20bbd-9862-4a09-bf6d-a2403f1db0c9/volumes"
Sep 08 15:20:55.197131 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197096    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"]
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197603    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f20bbd-9862-4a09-bf6d-a2403f1db0c9" containerName="maas-api"
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197618    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f20bbd-9862-4a09-bf6d-a2403f1db0c9" containerName="maas-api"
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197631    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy"
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197636    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy"
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197648    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy"
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197654    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy"
Sep 08 15:20:55.197719 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197713    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy"
Sep 08 15:20:55.197980 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197726    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="094ae466-c18c-4d08-837e-4798baa731bb" containerName="istio-proxy"
Sep 08 15:20:55.197980 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.197739    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f20bbd-9862-4a09-bf6d-a2403f1db0c9" containerName="maas-api"
Sep 08 15:20:55.202750 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.202730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.205277 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.205254    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-fa02a8-openshift-default-dockercfg-q7ddv\""
Sep 08 15:20:55.212731 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.212707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"]
Sep 08 15:20:55.300002 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.299970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5884\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-kube-api-access-l5884\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300140 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300012    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40427628-1515-4f27-be6f-af8d890eb361-istiod-ca-cert\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300140 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-certs\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300140 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-envoy\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300140 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300130    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40427628-1515-4f27-be6f-af8d890eb361-istio-podinfo\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300280 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300147    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-data\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300280 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-socket\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300280 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300205    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-istio-token\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.300280 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.300222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-credential-socket\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401373 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-envoy\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401526 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40427628-1515-4f27-be6f-af8d890eb361-istio-podinfo\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401526 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-data\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401526 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-socket\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401526 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-istio-token\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401526 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401514    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-credential-socket\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5884\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-kube-api-access-l5884\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40427628-1515-4f27-be6f-af8d890eb361-istiod-ca-cert\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-certs\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.401962 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.401829    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-socket\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.402026 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.402003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-data\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.402070 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.402016    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-certs\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.402240 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.402220    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-credential-socket\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.402440 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.402422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40427628-1515-4f27-be6f-af8d890eb361-istiod-ca-cert\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.403535 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.403518    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-envoy\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.404065 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.404039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40427628-1515-4f27-be6f-af8d890eb361-istio-podinfo\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.409313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.409291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-istio-token\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.409404 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.409325    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5884\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-kube-api-access-l5884\") pod \"e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") " pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.515980 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.515914    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:55.796659 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.796634    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"]
Sep 08 15:20:55.797883 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:20:55.797854    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40427628_1515_4f27_be6f_af8d890eb361.slice/crio-e732efdea9abb7d1886977daaa21d1c6ac3b8eeec09724d6c85297c633414650 WatchSource:0}: Error finding container e732efdea9abb7d1886977daaa21d1c6ac3b8eeec09724d6c85297c633414650: Status 404 returned error can't find the container with id e732efdea9abb7d1886977daaa21d1c6ac3b8eeec09724d6c85297c633414650
Sep 08 15:20:55.800513 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.800479    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:55.800625 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.800554    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:55.800625 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:55.800598    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:20:56.435290 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:56.435252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" event={"ID":"40427628-1515-4f27-be6f-af8d890eb361","Type":"ContainerStarted","Data":"3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"}
Sep 08 15:20:56.435700 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:56.435306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" event={"ID":"40427628-1515-4f27-be6f-af8d890eb361","Type":"ContainerStarted","Data":"e732efdea9abb7d1886977daaa21d1c6ac3b8eeec09724d6c85297c633414650"}
Sep 08 15:20:56.458252 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:56.458195    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podStartSLOduration=1.458175799 podStartE2EDuration="1.458175799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:56.457411683 +0000 UTC m=+1547.604432589" watchObservedRunningTime="2026-09-08 15:20:56.458175799 +0000 UTC m=+1547.605196715"
Sep 08 15:20:56.516807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:56.516783    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:56.521697 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:56.521677    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:57.445082 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:57.445046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:57.448723 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:57.448697    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:20:59.587746 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.587713    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"]
Sep 08 15:20:59.591411 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.591393    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.593721 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.593693    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-fa02a8-serving-cert\""
Sep 08 15:20:59.604796 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.604773    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"]
Sep 08 15:20:59.740704 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.740675    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffbjs\" (UniqueName: \"kubernetes.io/projected/edf9475a-14ae-4cd3-83b3-b5aa50819960-kube-api-access-ffbjs\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.740865 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.740721    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.740865 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.740780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-metrics-certs\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.740865 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.740823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf9475a-14ae-4cd3-83b3-b5aa50819960-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.841797 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.841723    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf9475a-14ae-4cd3-83b3-b5aa50819960-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.841797 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.841771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffbjs\" (UniqueName: \"kubernetes.io/projected/edf9475a-14ae-4cd3-83b3-b5aa50819960-kube-api-access-ffbjs\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.841974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.841815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.841974 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.841847    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-metrics-certs\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.841974 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:59.841947    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-serving-cert: secret "maas-api-e2e-ipp-b-fa02a8-serving-cert" not found
Sep 08 15:20:59.842077 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:20:59.842024    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls podName:edf9475a-14ae-4cd3-83b3-b5aa50819960 nodeName:}" failed. No retries permitted until 2026-09-08 15:21:00.342000719 +0000 UTC m=+1551.489021611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls") pod "maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" (UID: "edf9475a-14ae-4cd3-83b3-b5aa50819960") : secret "maas-api-e2e-ipp-b-fa02a8-serving-cert" not found
Sep 08 15:20:59.842499 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.842474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf9475a-14ae-4cd3-83b3-b5aa50819960-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.844331 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.844304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-metrics-certs\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:20:59.851073 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:20:59.851053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffbjs\" (UniqueName: \"kubernetes.io/projected/edf9475a-14ae-4cd3-83b3-b5aa50819960-kube-api-access-ffbjs\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:21:00.346568 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:00.346534    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:21:00.348769 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:00.348741    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls\") pod \"maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:21:00.504604 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:00.504572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:21:00.780295 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:00.780267    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"]
Sep 08 15:21:00.781506 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:21:00.781481    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedf9475a_14ae_4cd3_83b3_b5aa50819960.slice/crio-243d1318a087db3275e754fbca808c39cc8573ca044defd1daaddaa549822d50 WatchSource:0}: Error finding container 243d1318a087db3275e754fbca808c39cc8573ca044defd1daaddaa549822d50: Status 404 returned error can't find the container with id 243d1318a087db3275e754fbca808c39cc8573ca044defd1daaddaa549822d50
Sep 08 15:21:01.470031 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:01.469992    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" event={"ID":"edf9475a-14ae-4cd3-83b3-b5aa50819960","Type":"ContainerStarted","Data":"243d1318a087db3275e754fbca808c39cc8573ca044defd1daaddaa549822d50"}
Sep 08 15:21:02.477670 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:02.477637    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" event={"ID":"edf9475a-14ae-4cd3-83b3-b5aa50819960","Type":"ContainerStarted","Data":"a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc"}
Sep 08 15:21:02.478128 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:02.477801    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:21:02.495876 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:02.495834    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" podStartSLOduration=2.278231366 podStartE2EDuration="3.495819483s" totalImagesPullingTime="1.217588117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:21:02.493960179 +0000 UTC m=+1553.640981086" watchObservedRunningTime="2026-09-08 15:21:02.495819483 +0000 UTC m=+1553.642840390"
Sep 08 15:21:08.489736 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:08.489704    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:21:13.486581 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:13.486546    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:21:13.486961 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:13.486602    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:21:14.557208 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:14.557181    2579 generic.go:356] "Generic (PLEG): container finished" podID="40427628-1515-4f27-be6f-af8d890eb361" containerID="3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab" exitCode=0
Sep 08 15:21:14.557584 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:14.557251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" event={"ID":"40427628-1515-4f27-be6f-af8d890eb361","Type":"ContainerDied","Data":"3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"}
Sep 08 15:21:14.557730 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:14.557713    2579 scope.go:117] "RemoveContainer" containerID="3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"
Sep 08 15:21:14.558843 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:14.558816    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:21:14.558926 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:14.558878    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:21:14.558926 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:14.558908    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 15:21:15.570928 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:15.570889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" event={"ID":"40427628-1515-4f27-be6f-af8d890eb361","Type":"ContainerStarted","Data":"ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f"}
Sep 08 15:21:16.516259 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:16.516221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:21:16.516433 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:16.516391    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 15:21:16.516519 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:16.516436    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 15:21:17.516293 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:17.516255    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 15:21:17.516720 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:17.516311    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 15:21:18.516943 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:18.516909    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 15:21:18.517310 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:18.516963    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 15:21:19.516666 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:19.516630    2579 patch_prober.go:28] interesting pod/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 15:21:19.516843 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:19.516691    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 15:21:20.666775 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:20.666740    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:21:20.667243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:20.667202    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:21:20.667985 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:20.667964    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:21:28.461000 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:21:28.460970    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dgtj8_e68bc3b2-e101-4f36-ab0d-9c8df0f9340a/payload-processing/0.log"
Sep 08 15:22:01.358559 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:01.358529    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dgtj8_e68bc3b2-e101-4f36-ab0d-9c8df0f9340a/payload-processing/0.log"
Sep 08 15:22:06.139917 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.139836    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"]
Sep 08 15:22:06.142923 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.142901    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.145161 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.145137    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-f9a001-serving-cert\""
Sep 08 15:22:06.155036 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.155014    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"]
Sep 08 15:22:06.220941 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.220920    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.221054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.220981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.221054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.221000    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m7t5\" (UniqueName: \"kubernetes.io/projected/d32e44bc-c190-4c14-aa80-3ee9d03825fb-kube-api-access-9m7t5\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.221054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.221029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32e44bc-c190-4c14-aa80-3ee9d03825fb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.321827 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.321792    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32e44bc-c190-4c14-aa80-3ee9d03825fb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.321988 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.321893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.322059 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.322001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.322059 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.322027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m7t5\" (UniqueName: \"kubernetes.io/projected/d32e44bc-c190-4c14-aa80-3ee9d03825fb-kube-api-access-9m7t5\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.322169 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:22:06.322142    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-serving-cert: secret "maas-api-e2e-ipp-cleanup-f9a001-serving-cert" not found
Sep 08 15:22:06.322245 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:22:06.322230    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls podName:d32e44bc-c190-4c14-aa80-3ee9d03825fb nodeName:}" failed. No retries permitted until 2026-09-08 15:22:06.822208774 +0000 UTC m=+1617.969229660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" (UID: "d32e44bc-c190-4c14-aa80-3ee9d03825fb") : secret "maas-api-e2e-ipp-cleanup-f9a001-serving-cert" not found
Sep 08 15:22:06.322494 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.322471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32e44bc-c190-4c14-aa80-3ee9d03825fb-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.324363 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.324331    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.330595 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.330575    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m7t5\" (UniqueName: \"kubernetes.io/projected/d32e44bc-c190-4c14-aa80-3ee9d03825fb-kube-api-access-9m7t5\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.825824 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.825793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:06.828147 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:06.828121    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:07.056157 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:07.056125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:07.330386 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:07.330352    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"]
Sep 08 15:22:07.331348 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:22:07.331323    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32e44bc_c190_4c14_aa80_3ee9d03825fb.slice/crio-82d961194b1d3dbc84f0f96f4978306001ab02c8780f48953fd470142d17ded1 WatchSource:0}: Error finding container 82d961194b1d3dbc84f0f96f4978306001ab02c8780f48953fd470142d17ded1: Status 404 returned error can't find the container with id 82d961194b1d3dbc84f0f96f4978306001ab02c8780f48953fd470142d17ded1
Sep 08 15:22:07.332845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:07.332828    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:22:07.898099 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:07.898069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" event={"ID":"d32e44bc-c190-4c14-aa80-3ee9d03825fb","Type":"ContainerStarted","Data":"82d961194b1d3dbc84f0f96f4978306001ab02c8780f48953fd470142d17ded1"}
Sep 08 15:22:08.912828 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:08.912792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" event={"ID":"d32e44bc-c190-4c14-aa80-3ee9d03825fb","Type":"ContainerStarted","Data":"4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8"}
Sep 08 15:22:08.913214 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:08.912882    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:08.931830 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:08.931788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" podStartSLOduration=2.220361572 podStartE2EDuration="2.931775469s" totalImagesPullingTime="711.413897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:08.931019944 +0000 UTC m=+1620.078040865" watchObservedRunningTime="2026-09-08 15:22:08.931775469 +0000 UTC m=+1620.078796375"
Sep 08 15:22:14.923778 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:14.923736    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:36.746939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:36.746903    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"]
Sep 08 15:22:36.747514 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:36.747164    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" podUID="d32e44bc-c190-4c14-aa80-3ee9d03825fb" containerName="maas-api" containerID="cri-o://4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8" gracePeriod=30
Sep 08 15:22:36.991278 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:36.991255    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:37.078681 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.078603    2579 generic.go:356] "Generic (PLEG): container finished" podID="d32e44bc-c190-4c14-aa80-3ee9d03825fb" containerID="4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8" exitCode=0
Sep 08 15:22:37.078681 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.078656    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"
Sep 08 15:22:37.078845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.078688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" event={"ID":"d32e44bc-c190-4c14-aa80-3ee9d03825fb","Type":"ContainerDied","Data":"4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8"}
Sep 08 15:22:37.078845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.078773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx" event={"ID":"d32e44bc-c190-4c14-aa80-3ee9d03825fb","Type":"ContainerDied","Data":"82d961194b1d3dbc84f0f96f4978306001ab02c8780f48953fd470142d17ded1"}
Sep 08 15:22:37.078845 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.078801    2579 scope.go:117] "RemoveContainer" containerID="4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8"
Sep 08 15:22:37.087908 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.087886    2579 scope.go:117] "RemoveContainer" containerID="4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8"
Sep 08 15:22:37.088171 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:22:37.088153    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8\": container with ID starting with 4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8 not found: ID does not exist" containerID="4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8"
Sep 08 15:22:37.088225 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.088179    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8"} err="failed to get container status \"4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8\": rpc error: code = NotFound desc = could not find container \"4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8\": container with ID starting with 4701e46f4b089d6482a179ae44cbdb994ccb12989bbc986ed6c1f6afb1f63aa8 not found: ID does not exist"
Sep 08 15:22:37.097956 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.097936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m7t5\" (UniqueName: \"kubernetes.io/projected/d32e44bc-c190-4c14-aa80-3ee9d03825fb-kube-api-access-9m7t5\") pod \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") "
Sep 08 15:22:37.098060 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.098005    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-metrics-certs\") pod \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") "
Sep 08 15:22:37.098060 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.098021    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls\") pod \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") "
Sep 08 15:22:37.098060 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.098041    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32e44bc-c190-4c14-aa80-3ee9d03825fb-openshift-service-ca\") pod \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\" (UID: \"d32e44bc-c190-4c14-aa80-3ee9d03825fb\") "
Sep 08 15:22:37.098532 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.098504    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d32e44bc-c190-4c14-aa80-3ee9d03825fb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d32e44bc-c190-4c14-aa80-3ee9d03825fb" (UID: "d32e44bc-c190-4c14-aa80-3ee9d03825fb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:22:37.100009 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.099977    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d32e44bc-c190-4c14-aa80-3ee9d03825fb" (UID: "d32e44bc-c190-4c14-aa80-3ee9d03825fb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:22:37.100115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.100035    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d32e44bc-c190-4c14-aa80-3ee9d03825fb" (UID: "d32e44bc-c190-4c14-aa80-3ee9d03825fb"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:22:37.100115 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.100053    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d32e44bc-c190-4c14-aa80-3ee9d03825fb-kube-api-access-9m7t5" (OuterVolumeSpecName: "kube-api-access-9m7t5") pod "d32e44bc-c190-4c14-aa80-3ee9d03825fb" (UID: "d32e44bc-c190-4c14-aa80-3ee9d03825fb"). InnerVolumeSpecName "kube-api-access-9m7t5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:22:37.199282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.199253    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:22:37.199282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.199280    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d32e44bc-c190-4c14-aa80-3ee9d03825fb-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:22:37.199282 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.199288    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d32e44bc-c190-4c14-aa80-3ee9d03825fb-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:22:37.199529 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.199298    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m7t5\" (UniqueName: \"kubernetes.io/projected/d32e44bc-c190-4c14-aa80-3ee9d03825fb-kube-api-access-9m7t5\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:22:37.403189 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.403157    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"]
Sep 08 15:22:37.409003 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:37.408980    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-f9a001-765c5ddd48-lw9tx"]
Sep 08 15:22:39.388589 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:22:39.388554    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d32e44bc-c190-4c14-aa80-3ee9d03825fb" path="/var/lib/kubelet/pods/d32e44bc-c190-4c14-aa80-3ee9d03825fb/volumes"
Sep 08 15:23:03.035054 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.035017    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"]
Sep 08 15:23:03.035612 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.035267    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" podUID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" containerName="maas-api" containerID="cri-o://b6e00720ae79d87c28945ce4a941b0ef8ad4545da35b1583c261bbf83a83f3f4" gracePeriod=30
Sep 08 15:23:03.238958 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.238924    2579 generic.go:356] "Generic (PLEG): container finished" podID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" containerID="b6e00720ae79d87c28945ce4a941b0ef8ad4545da35b1583c261bbf83a83f3f4" exitCode=0
Sep 08 15:23:03.239101 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.238997    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" event={"ID":"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956","Type":"ContainerDied","Data":"b6e00720ae79d87c28945ce4a941b0ef8ad4545da35b1583c261bbf83a83f3f4"}
Sep 08 15:23:03.294571 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.294516    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:23:03.323913 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.323888    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-metrics-certs\") pod \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") "
Sep 08 15:23:03.324051 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.323946    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-872v9\" (UniqueName: \"kubernetes.io/projected/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-kube-api-access-872v9\") pod \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") "
Sep 08 15:23:03.324051 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.323970    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-openshift-service-ca\") pod \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") "
Sep 08 15:23:03.324051 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.324008    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls\") pod \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\" (UID: \"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956\") "
Sep 08 15:23:03.324324 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.324298    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" (UID: "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:23:03.326041 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.326012    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" (UID: "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:23:03.326141 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.326121    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" (UID: "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:23:03.326187 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.326161    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-kube-api-access-872v9" (OuterVolumeSpecName: "kube-api-access-872v9") pod "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" (UID: "d2a21ea8-0dd9-47bb-a2fc-055d6fae6956"). InnerVolumeSpecName "kube-api-access-872v9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:23:03.427089 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.427061    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:23:03.427089 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.427089    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-872v9\" (UniqueName: \"kubernetes.io/projected/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-kube-api-access-872v9\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:23:03.427323 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.427100    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:23:03.427323 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:03.427108    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:23:04.247240 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:04.247211    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"
Sep 08 15:23:04.247652 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:04.247242    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" event={"ID":"d2a21ea8-0dd9-47bb-a2fc-055d6fae6956","Type":"ContainerDied","Data":"72780b9702b6b28c2217c7ad6074db525ae7a450d7ac2541455bae3be9bca685"}
Sep 08 15:23:04.247652 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:04.247308    2579 scope.go:117] "RemoveContainer" containerID="b6e00720ae79d87c28945ce4a941b0ef8ad4545da35b1583c261bbf83a83f3f4"
Sep 08 15:23:04.264319 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:04.264296    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"]
Sep 08 15:23:04.268612 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:04.268592    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb"]
Sep 08 15:23:05.388680 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:05.388649    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" path="/var/lib/kubelet/pods/d2a21ea8-0dd9-47bb-a2fc-055d6fae6956/volumes"
Sep 08 15:23:06.282883 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:23:06.282830    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-bdd5c7-6cc5c7b447-kgfjb" podUID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.79:8443/health\": context deadline exceeded"
Sep 08 15:24:02.653993 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.653957    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"]
Sep 08 15:24:02.654562 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.654240    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" podUID="edf9475a-14ae-4cd3-83b3-b5aa50819960" containerName="maas-api" containerID="cri-o://a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc" gracePeriod=30
Sep 08 15:24:02.905831 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.905772    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:24:02.945077 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.945042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-metrics-certs\") pod \"edf9475a-14ae-4cd3-83b3-b5aa50819960\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") "
Sep 08 15:24:02.945249 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.945108    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffbjs\" (UniqueName: \"kubernetes.io/projected/edf9475a-14ae-4cd3-83b3-b5aa50819960-kube-api-access-ffbjs\") pod \"edf9475a-14ae-4cd3-83b3-b5aa50819960\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") "
Sep 08 15:24:02.945249 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.945161    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls\") pod \"edf9475a-14ae-4cd3-83b3-b5aa50819960\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") "
Sep 08 15:24:02.945249 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.945205    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf9475a-14ae-4cd3-83b3-b5aa50819960-openshift-service-ca\") pod \"edf9475a-14ae-4cd3-83b3-b5aa50819960\" (UID: \"edf9475a-14ae-4cd3-83b3-b5aa50819960\") "
Sep 08 15:24:02.945685 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.945641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edf9475a-14ae-4cd3-83b3-b5aa50819960-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edf9475a-14ae-4cd3-83b3-b5aa50819960" (UID: "edf9475a-14ae-4cd3-83b3-b5aa50819960"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:02.947480 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.947430    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edf9475a-14ae-4cd3-83b3-b5aa50819960-kube-api-access-ffbjs" (OuterVolumeSpecName: "kube-api-access-ffbjs") pod "edf9475a-14ae-4cd3-83b3-b5aa50819960" (UID: "edf9475a-14ae-4cd3-83b3-b5aa50819960"). InnerVolumeSpecName "kube-api-access-ffbjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:02.947736 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.947704    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "edf9475a-14ae-4cd3-83b3-b5aa50819960" (UID: "edf9475a-14ae-4cd3-83b3-b5aa50819960"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:02.947867 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:02.947728    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edf9475a-14ae-4cd3-83b3-b5aa50819960" (UID: "edf9475a-14ae-4cd3-83b3-b5aa50819960"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:03.046081 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.046048    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffbjs\" (UniqueName: \"kubernetes.io/projected/edf9475a-14ae-4cd3-83b3-b5aa50819960-kube-api-access-ffbjs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.046224 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.046084    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.046224 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.046100    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edf9475a-14ae-4cd3-83b3-b5aa50819960-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.046224 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.046114    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edf9475a-14ae-4cd3-83b3-b5aa50819960-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:03.596772 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.596737    2579 generic.go:356] "Generic (PLEG): container finished" podID="edf9475a-14ae-4cd3-83b3-b5aa50819960" containerID="a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc" exitCode=0
Sep 08 15:24:03.596931 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.596779    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"
Sep 08 15:24:03.596931 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.596828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" event={"ID":"edf9475a-14ae-4cd3-83b3-b5aa50819960","Type":"ContainerDied","Data":"a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc"}
Sep 08 15:24:03.596931 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.596881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh" event={"ID":"edf9475a-14ae-4cd3-83b3-b5aa50819960","Type":"ContainerDied","Data":"243d1318a087db3275e754fbca808c39cc8573ca044defd1daaddaa549822d50"}
Sep 08 15:24:03.596931 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.596905    2579 scope.go:117] "RemoveContainer" containerID="a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc"
Sep 08 15:24:03.606257 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.606241    2579 scope.go:117] "RemoveContainer" containerID="a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc"
Sep 08 15:24:03.606584 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:24:03.606561    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc\": container with ID starting with a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc not found: ID does not exist" containerID="a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc"
Sep 08 15:24:03.606693 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.606592    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc"} err="failed to get container status \"a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc\": rpc error: code = NotFound desc = could not find container \"a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc\": container with ID starting with a763bf237880b80cd268797dd5529c6e8c649097984e9207121c96a4dc91b8fc not found: ID does not exist"
Sep 08 15:24:03.613668 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.613647    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"]
Sep 08 15:24:03.622939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:03.622919    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-fa02a8-5d7c6b4bb5-2fzrh"]
Sep 08 15:24:05.388346 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:05.388315    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edf9475a-14ae-4cd3-83b3-b5aa50819960" path="/var/lib/kubelet/pods/edf9475a-14ae-4cd3-83b3-b5aa50819960/volumes"
Sep 08 15:24:09.835506 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:09.835472    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"]
Sep 08 15:24:09.835935 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:09.835683    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy" containerID="cri-o://ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f" gracePeriod=30
Sep 08 15:24:15.083055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.083025    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:24:15.156943 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.156906    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5884\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-kube-api-access-l5884\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157145 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.156952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-credential-socket\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157145 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.156979    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-data\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157145 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157029    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40427628-1515-4f27-be6f-af8d890eb361-istio-podinfo\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157145 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157061    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40427628-1515-4f27-be6f-af8d890eb361-istiod-ca-cert\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157145 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157100    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-socket\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157167    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-istio-token\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157193    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-envoy\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157290    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:15.157425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157327    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-certs\") pod \"40427628-1515-4f27-be6f-af8d890eb361\" (UID: \"40427628-1515-4f27-be6f-af8d890eb361\") "
Sep 08 15:24:15.157425 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157349    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-data" (OuterVolumeSpecName: "istio-data") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:15.157748 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157484    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:15.157806 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157768    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.157806 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157787    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-credential-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.157806 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157801    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-data\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.157968 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157826    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40427628-1515-4f27-be6f-af8d890eb361-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:15.157968 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.157880    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:15.159292 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.159262    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40427628-1515-4f27-be6f-af8d890eb361-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:24:15.159292 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.159278    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-kube-api-access-l5884" (OuterVolumeSpecName: "kube-api-access-l5884") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "kube-api-access-l5884". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:15.159436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.159313    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-istio-token" (OuterVolumeSpecName: "istio-token") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:15.159674 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.159656    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40427628-1515-4f27-be6f-af8d890eb361" (UID: "40427628-1515-4f27-be6f-af8d890eb361"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:24:15.258886 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.258855    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-istio-token\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.258886 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.258881    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-istio-envoy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.259065 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.258894    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5884\" (UniqueName: \"kubernetes.io/projected/40427628-1515-4f27-be6f-af8d890eb361-kube-api-access-l5884\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.259065 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.258909    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40427628-1515-4f27-be6f-af8d890eb361-istio-podinfo\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.259065 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.258921    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40427628-1515-4f27-be6f-af8d890eb361-istiod-ca-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.259065 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.258931    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40427628-1515-4f27-be6f-af8d890eb361-workload-socket\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:15.672573 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.672533    2579 generic.go:356] "Generic (PLEG): container finished" podID="40427628-1515-4f27-be6f-af8d890eb361" containerID="ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f" exitCode=0
Sep 08 15:24:15.672746 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.672580    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"
Sep 08 15:24:15.672746 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.672615    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" event={"ID":"40427628-1515-4f27-be6f-af8d890eb361","Type":"ContainerDied","Data":"ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f"}
Sep 08 15:24:15.672746 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.672678    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq" event={"ID":"40427628-1515-4f27-be6f-af8d890eb361","Type":"ContainerDied","Data":"e732efdea9abb7d1886977daaa21d1c6ac3b8eeec09724d6c85297c633414650"}
Sep 08 15:24:15.672746 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.672706    2579 scope.go:117] "RemoveContainer" containerID="ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f"
Sep 08 15:24:15.682188 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.682170    2579 scope.go:117] "RemoveContainer" containerID="3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"
Sep 08 15:24:15.690631 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.690602    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"]
Sep 08 15:24:15.691340 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.691285    2579 scope.go:117] "RemoveContainer" containerID="ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f"
Sep 08 15:24:15.691733 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:24:15.691634    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f\": container with ID starting with ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f not found: ID does not exist" containerID="ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f"
Sep 08 15:24:15.691733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.691670    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f"} err="failed to get container status \"ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f\": rpc error: code = NotFound desc = could not find container \"ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f\": container with ID starting with ead1eca13b087d9af564175d3f28ae458a168885dd7084db9a8240b853933b6f not found: ID does not exist"
Sep 08 15:24:15.691733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.691691    2579 scope.go:117] "RemoveContainer" containerID="3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"
Sep 08 15:24:15.692259 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:24:15.692234    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab\": container with ID starting with 3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab not found: ID does not exist" containerID="3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"
Sep 08 15:24:15.692350 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.692265    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab"} err="failed to get container status \"3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab\": rpc error: code = NotFound desc = could not find container \"3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab\": container with ID starting with 3f1822dedd62980a316c7dd2f1d710e163cb4841aa04ccff03731c357fa2d9ab not found: ID does not exist"
Sep 08 15:24:15.694543 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:15.694523    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-fa02a8-openshift-default-6d4c475788-2wqcq"]
Sep 08 15:24:17.388706 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:17.388669    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40427628-1515-4f27-be6f-af8d890eb361" path="/var/lib/kubelet/pods/40427628-1515-4f27-be6f-af8d890eb361/volumes"
Sep 08 15:24:20.775975 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:20.775940    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"]
Sep 08 15:24:20.776732 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:20.776698    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d" podUID="8101e690-bd4b-4147-b418-d72dbe8b0afa" containerName="maas-api" containerID="cri-o://c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8" gracePeriod=30
Sep 08 15:24:21.027434 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.027374    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:24:21.110962 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.110928    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-metrics-certs\") pod \"8101e690-bd4b-4147-b418-d72dbe8b0afa\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") "
Sep 08 15:24:21.111111 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.110976    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-maas-api-tls\") pod \"8101e690-bd4b-4147-b418-d72dbe8b0afa\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") "
Sep 08 15:24:21.111111 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.111074    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8101e690-bd4b-4147-b418-d72dbe8b0afa-openshift-service-ca\") pod \"8101e690-bd4b-4147-b418-d72dbe8b0afa\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") "
Sep 08 15:24:21.111188 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.111155    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwrfq\" (UniqueName: \"kubernetes.io/projected/8101e690-bd4b-4147-b418-d72dbe8b0afa-kube-api-access-xwrfq\") pod \"8101e690-bd4b-4147-b418-d72dbe8b0afa\" (UID: \"8101e690-bd4b-4147-b418-d72dbe8b0afa\") "
Sep 08 15:24:21.111386 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.111365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8101e690-bd4b-4147-b418-d72dbe8b0afa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8101e690-bd4b-4147-b418-d72dbe8b0afa" (UID: "8101e690-bd4b-4147-b418-d72dbe8b0afa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:21.111520 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.111504    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8101e690-bd4b-4147-b418-d72dbe8b0afa-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:21.113118 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.113086    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8101e690-bd4b-4147-b418-d72dbe8b0afa" (UID: "8101e690-bd4b-4147-b418-d72dbe8b0afa"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:21.113226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.113120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8101e690-bd4b-4147-b418-d72dbe8b0afa" (UID: "8101e690-bd4b-4147-b418-d72dbe8b0afa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:21.113226 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.113142    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8101e690-bd4b-4147-b418-d72dbe8b0afa-kube-api-access-xwrfq" (OuterVolumeSpecName: "kube-api-access-xwrfq") pod "8101e690-bd4b-4147-b418-d72dbe8b0afa" (UID: "8101e690-bd4b-4147-b418-d72dbe8b0afa"). InnerVolumeSpecName "kube-api-access-xwrfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:21.212594 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.212560    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:21.212594 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.212590    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8101e690-bd4b-4147-b418-d72dbe8b0afa-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:21.212766 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.212602    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwrfq\" (UniqueName: \"kubernetes.io/projected/8101e690-bd4b-4147-b418-d72dbe8b0afa-kube-api-access-xwrfq\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:21.719097 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.719003    2579 generic.go:356] "Generic (PLEG): container finished" podID="8101e690-bd4b-4147-b418-d72dbe8b0afa" containerID="c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8" exitCode=0
Sep 08 15:24:21.719097 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.719053    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"
Sep 08 15:24:21.719309 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.719092    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d" event={"ID":"8101e690-bd4b-4147-b418-d72dbe8b0afa","Type":"ContainerDied","Data":"c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8"}
Sep 08 15:24:21.719309 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.719150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d" event={"ID":"8101e690-bd4b-4147-b418-d72dbe8b0afa","Type":"ContainerDied","Data":"e26a5aca35df9721d7cec8ebe4b8c12d46bf9fc70adfd2f2d5c8142b5a3808fb"}
Sep 08 15:24:21.719309 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.719178    2579 scope.go:117] "RemoveContainer" containerID="c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8"
Sep 08 15:24:21.730655 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.730631    2579 scope.go:117] "RemoveContainer" containerID="c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8"
Sep 08 15:24:21.730943 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:24:21.730924    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8\": container with ID starting with c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8 not found: ID does not exist" containerID="c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8"
Sep 08 15:24:21.731022 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.730955    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8"} err="failed to get container status \"c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8\": rpc error: code = NotFound desc = could not find container \"c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8\": container with ID starting with c23cb5ae9816f8ace6231cdcc448f60825a66c06ddf22a003534cb223523dde8 not found: ID does not exist"
Sep 08 15:24:21.738944 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.738921    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"]
Sep 08 15:24:21.742611 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:21.742588    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-ffa941-666c949744-pjk2d"]
Sep 08 15:24:23.394600 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:23.394568    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8101e690-bd4b-4147-b418-d72dbe8b0afa" path="/var/lib/kubelet/pods/8101e690-bd4b-4147-b418-d72dbe8b0afa/volumes"
Sep 08 15:24:39.117982 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.117933    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"]
Sep 08 15:24:39.118614 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.118230    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl" podUID="46971275-5d56-4fc6-806c-0cbb1b3419dc" containerName="maas-api" containerID="cri-o://e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962" gracePeriod=30
Sep 08 15:24:39.364053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.364030    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:24:39.463735 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.463706    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tk7dt\" (UniqueName: \"kubernetes.io/projected/46971275-5d56-4fc6-806c-0cbb1b3419dc-kube-api-access-tk7dt\") pod \"46971275-5d56-4fc6-806c-0cbb1b3419dc\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") "
Sep 08 15:24:39.463889 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.463754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-maas-api-tls\") pod \"46971275-5d56-4fc6-806c-0cbb1b3419dc\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") "
Sep 08 15:24:39.463889 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.463782    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46971275-5d56-4fc6-806c-0cbb1b3419dc-openshift-service-ca\") pod \"46971275-5d56-4fc6-806c-0cbb1b3419dc\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") "
Sep 08 15:24:39.463889 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.463827    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-metrics-certs\") pod \"46971275-5d56-4fc6-806c-0cbb1b3419dc\" (UID: \"46971275-5d56-4fc6-806c-0cbb1b3419dc\") "
Sep 08 15:24:39.464182 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.464153    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46971275-5d56-4fc6-806c-0cbb1b3419dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "46971275-5d56-4fc6-806c-0cbb1b3419dc" (UID: "46971275-5d56-4fc6-806c-0cbb1b3419dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:24:39.465875 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.465845    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "46971275-5d56-4fc6-806c-0cbb1b3419dc" (UID: "46971275-5d56-4fc6-806c-0cbb1b3419dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:39.466318 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.466302    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46971275-5d56-4fc6-806c-0cbb1b3419dc-kube-api-access-tk7dt" (OuterVolumeSpecName: "kube-api-access-tk7dt") pod "46971275-5d56-4fc6-806c-0cbb1b3419dc" (UID: "46971275-5d56-4fc6-806c-0cbb1b3419dc"). InnerVolumeSpecName "kube-api-access-tk7dt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:24:39.466377 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.466305    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "46971275-5d56-4fc6-806c-0cbb1b3419dc" (UID: "46971275-5d56-4fc6-806c-0cbb1b3419dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:24:39.564507 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.564476    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tk7dt\" (UniqueName: \"kubernetes.io/projected/46971275-5d56-4fc6-806c-0cbb1b3419dc-kube-api-access-tk7dt\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:39.564507 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.564504    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:39.564668 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.564514    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/46971275-5d56-4fc6-806c-0cbb1b3419dc-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:39.564668 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.564523    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46971275-5d56-4fc6-806c-0cbb1b3419dc-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:24:39.827017 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.826935    2579 generic.go:356] "Generic (PLEG): container finished" podID="46971275-5d56-4fc6-806c-0cbb1b3419dc" containerID="e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962" exitCode=0
Sep 08 15:24:39.827017 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.826982    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"
Sep 08 15:24:39.827185 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.827025    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl" event={"ID":"46971275-5d56-4fc6-806c-0cbb1b3419dc","Type":"ContainerDied","Data":"e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962"}
Sep 08 15:24:39.827185 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.827078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl" event={"ID":"46971275-5d56-4fc6-806c-0cbb1b3419dc","Type":"ContainerDied","Data":"e3c5b6a6ab43784fcc2e64fcff03fd9edc5ba323028cc5b9a64d4cb43713b969"}
Sep 08 15:24:39.827185 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.827100    2579 scope.go:117] "RemoveContainer" containerID="e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962"
Sep 08 15:24:39.836742 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.836721    2579 scope.go:117] "RemoveContainer" containerID="e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962"
Sep 08 15:24:39.836985 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:24:39.836967    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962\": container with ID starting with e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962 not found: ID does not exist" containerID="e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962"
Sep 08 15:24:39.837053 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.836992    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962"} err="failed to get container status \"e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962\": rpc error: code = NotFound desc = could not find container \"e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962\": container with ID starting with e69de72bf380d1a0ae8dcbb3796a37ac873bfecd49124414e0c601a2f9168962 not found: ID does not exist"
Sep 08 15:24:39.856180 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.856153    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"]
Sep 08 15:24:39.862470 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:39.862433    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-7be222-67d6bff994-bbsxl"]
Sep 08 15:24:41.388718 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:24:41.388686    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46971275-5d56-4fc6-806c-0cbb1b3419dc" path="/var/lib/kubelet/pods/46971275-5d56-4fc6-806c-0cbb1b3419dc/volumes"
Sep 08 15:25:09.432350 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:25:09.432322    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:25:09.437402 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:25:09.437383    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:25:09.443807 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:25:09.443779    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:25:09.448283 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:25:09.448264    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:25:09.635370 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:25:09.635349    2579 scope.go:117] "RemoveContainer" containerID="85921bb64f8f4e3b042d415947b1a6776516f84170e68a0868447fd91af0de32"
Sep 08 15:27:26.386242 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:26.386200    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"]
Sep 08 15:27:26.386853 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:26.386490    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h" podUID="7023de6e-542e-4059-8397-ab9949b80487" containerName="manager" containerID="cri-o://2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae" gracePeriod=10
Sep 08 15:27:27.231967 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.231943    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:27:27.303500 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.303475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmtcf\" (UniqueName: \"kubernetes.io/projected/7023de6e-542e-4059-8397-ab9949b80487-kube-api-access-qmtcf\") pod \"7023de6e-542e-4059-8397-ab9949b80487\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") "
Sep 08 15:27:27.303672 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.303572    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7023de6e-542e-4059-8397-ab9949b80487-extensions-socket-volume\") pod \"7023de6e-542e-4059-8397-ab9949b80487\" (UID: \"7023de6e-542e-4059-8397-ab9949b80487\") "
Sep 08 15:27:27.303952 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.303930    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7023de6e-542e-4059-8397-ab9949b80487-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7023de6e-542e-4059-8397-ab9949b80487" (UID: "7023de6e-542e-4059-8397-ab9949b80487"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:27.305622 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.305598    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7023de6e-542e-4059-8397-ab9949b80487-kube-api-access-qmtcf" (OuterVolumeSpecName: "kube-api-access-qmtcf") pod "7023de6e-542e-4059-8397-ab9949b80487" (UID: "7023de6e-542e-4059-8397-ab9949b80487"). InnerVolumeSpecName "kube-api-access-qmtcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:27.405105 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.405083    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7023de6e-542e-4059-8397-ab9949b80487-extensions-socket-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:27:27.405105 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.405107    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmtcf\" (UniqueName: \"kubernetes.io/projected/7023de6e-542e-4059-8397-ab9949b80487-kube-api-access-qmtcf\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:27:27.787884 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.787856    2579 generic.go:356] "Generic (PLEG): container finished" podID="7023de6e-542e-4059-8397-ab9949b80487" containerID="2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae" exitCode=0
Sep 08 15:27:27.788075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.787902    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"
Sep 08 15:27:27.788075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.787946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h" event={"ID":"7023de6e-542e-4059-8397-ab9949b80487","Type":"ContainerDied","Data":"2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae"}
Sep 08 15:27:27.788075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.788007    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h" event={"ID":"7023de6e-542e-4059-8397-ab9949b80487","Type":"ContainerDied","Data":"282c8d8f45d90b7dff3b20131e4206ff74cee98b95f7f0b9c901161ff74ddf8c"}
Sep 08 15:27:27.788075 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.788040    2579 scope.go:117] "RemoveContainer" containerID="2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae"
Sep 08 15:27:27.798920 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.798896    2579 scope.go:117] "RemoveContainer" containerID="2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae"
Sep 08 15:27:27.799187 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:27:27.799165    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae\": container with ID starting with 2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae not found: ID does not exist" containerID="2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae"
Sep 08 15:27:27.799239 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.799197    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae"} err="failed to get container status \"2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae\": rpc error: code = NotFound desc = could not find container \"2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae\": container with ID starting with 2c7b2efd5da18b28e99726a5c1beea1ebf57e7421459485ffc185cb7761a2bae not found: ID does not exist"
Sep 08 15:27:27.805761 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.805739    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"]
Sep 08 15:27:27.809265 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:27.809245    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-rfq2h"]
Sep 08 15:27:29.387872 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:27:29.387841    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7023de6e-542e-4059-8397-ab9949b80487" path="/var/lib/kubelet/pods/7023de6e-542e-4059-8397-ab9949b80487/volumes"
Sep 08 15:28:27.109291 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109252    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"]
Sep 08 15:28:27.109702 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109658    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" containerName="maas-api"
Sep 08 15:28:27.109702 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109670    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" containerName="maas-api"
Sep 08 15:28:27.109702 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109685    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edf9475a-14ae-4cd3-83b3-b5aa50819960" containerName="maas-api"
Sep 08 15:28:27.109702 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109690    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="edf9475a-14ae-4cd3-83b3-b5aa50819960" containerName="maas-api"
Sep 08 15:28:27.109702 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109705    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46971275-5d56-4fc6-806c-0cbb1b3419dc" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109710    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="46971275-5d56-4fc6-806c-0cbb1b3419dc" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109717    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d32e44bc-c190-4c14-aa80-3ee9d03825fb" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109722    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d32e44bc-c190-4c14-aa80-3ee9d03825fb" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109730    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109735    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109742    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7023de6e-542e-4059-8397-ab9949b80487" containerName="manager"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109747    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7023de6e-542e-4059-8397-ab9949b80487" containerName="manager"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109753    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8101e690-bd4b-4147-b418-d72dbe8b0afa" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109758    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8101e690-bd4b-4147-b418-d72dbe8b0afa" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109765    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109770    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109827    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109834    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="46971275-5d56-4fc6-806c-0cbb1b3419dc" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109840    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2a21ea8-0dd9-47bb-a2fc-055d6fae6956" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109849    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8101e690-bd4b-4147-b418-d72dbe8b0afa" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109855    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d32e44bc-c190-4c14-aa80-3ee9d03825fb" containerName="maas-api"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109862    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7023de6e-542e-4059-8397-ab9949b80487" containerName="manager"
Sep 08 15:28:27.109871 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.109869    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="edf9475a-14ae-4cd3-83b3-b5aa50819960" containerName="maas-api"
Sep 08 15:28:27.112860 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.112842    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.115784 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.115765    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2zmq6\""
Sep 08 15:28:27.125748 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.125724    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"]
Sep 08 15:28:27.165673 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.165644    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/465da0ef-c53d-49a2-90f3-50a22b6dfec3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p68x9\" (UID: \"465da0ef-c53d-49a2-90f3-50a22b6dfec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.165784 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.165694    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh87l\" (UniqueName: \"kubernetes.io/projected/465da0ef-c53d-49a2-90f3-50a22b6dfec3-kube-api-access-nh87l\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p68x9\" (UID: \"465da0ef-c53d-49a2-90f3-50a22b6dfec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.266225 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.266199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh87l\" (UniqueName: \"kubernetes.io/projected/465da0ef-c53d-49a2-90f3-50a22b6dfec3-kube-api-access-nh87l\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p68x9\" (UID: \"465da0ef-c53d-49a2-90f3-50a22b6dfec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.266379 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.266356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/465da0ef-c53d-49a2-90f3-50a22b6dfec3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p68x9\" (UID: \"465da0ef-c53d-49a2-90f3-50a22b6dfec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.266698 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.266680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/465da0ef-c53d-49a2-90f3-50a22b6dfec3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p68x9\" (UID: \"465da0ef-c53d-49a2-90f3-50a22b6dfec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.276811 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.276793    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh87l\" (UniqueName: \"kubernetes.io/projected/465da0ef-c53d-49a2-90f3-50a22b6dfec3-kube-api-access-nh87l\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-p68x9\" (UID: \"465da0ef-c53d-49a2-90f3-50a22b6dfec3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.423610 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.423586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:27.703705 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:27.703675    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"]
Sep 08 15:28:27.705142 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:28:27.705116    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465da0ef_c53d_49a2_90f3_50a22b6dfec3.slice/crio-d50576fb8748fa52ef2924a32b51305962aa1e28167f32518fac29cb2c553b98 WatchSource:0}: Error finding container d50576fb8748fa52ef2924a32b51305962aa1e28167f32518fac29cb2c553b98: Status 404 returned error can't find the container with id d50576fb8748fa52ef2924a32b51305962aa1e28167f32518fac29cb2c553b98
Sep 08 15:28:28.144291 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:28.144257    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9" event={"ID":"465da0ef-c53d-49a2-90f3-50a22b6dfec3","Type":"ContainerStarted","Data":"6de5a108ca2991d75e0b3b6a104adb174cacc343c75377cb71443f14fe7a5c71"}
Sep 08 15:28:28.144733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:28.144307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9" event={"ID":"465da0ef-c53d-49a2-90f3-50a22b6dfec3","Type":"ContainerStarted","Data":"d50576fb8748fa52ef2924a32b51305962aa1e28167f32518fac29cb2c553b98"}
Sep 08 15:28:28.144733 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:28.144391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:28:28.170313 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:28.170267    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9" podStartSLOduration=1.1702521479999999 podStartE2EDuration="1.170252148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:28:28.168364006 +0000 UTC m=+1999.315384913" watchObservedRunningTime="2026-09-08 15:28:28.170252148 +0000 UTC m=+1999.317273055"
Sep 08 15:28:39.152320 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:28:39.152288    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-p68x9"
Sep 08 15:30:07.367919 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.367885    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"]
Sep 08 15:30:07.368339 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.368316    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="40427628-1515-4f27-be6f-af8d890eb361" containerName="istio-proxy"
Sep 08 15:30:07.371456 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.371430    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.377152 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.377125    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-857r2\""
Sep 08 15:30:07.377296 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.377212    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:30:07.377296 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.377217    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 15:30:07.392981 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.392959    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"]
Sep 08 15:30:07.396396 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.396372    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"]
Sep 08 15:30:07.400624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.400602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.412948 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.412925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"]
Sep 08 15:30:07.461624 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.461597    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzbzn\" (UniqueName: \"kubernetes.io/projected/aba749c4-8336-4efb-80cd-94b13775b7bf-kube-api-access-wzbzn\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.461804 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.461649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba749c4-8336-4efb-80cd-94b13775b7bf-openshift-service-ca\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.461804 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.461714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f45b0e3-04f3-48c5-967a-a868d6697e9e-maas-api-tls\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.461934 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.461859    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f45b0e3-04f3-48c5-967a-a868d6697e9e-openshift-service-ca\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.461993 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.461931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq645\" (UniqueName: \"kubernetes.io/projected/8f45b0e3-04f3-48c5-967a-a868d6697e9e-kube-api-access-hq645\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.461993 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.461966    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-maas-api-tls\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.462119 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.462016    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f45b0e3-04f3-48c5-967a-a868d6697e9e-metrics-certs\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.462119 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.462050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-metrics-certs\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.562880 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.562851    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba749c4-8336-4efb-80cd-94b13775b7bf-openshift-service-ca\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.563006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.562900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f45b0e3-04f3-48c5-967a-a868d6697e9e-maas-api-tls\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.563006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.562936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f45b0e3-04f3-48c5-967a-a868d6697e9e-openshift-service-ca\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.563006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.562963    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq645\" (UniqueName: \"kubernetes.io/projected/8f45b0e3-04f3-48c5-967a-a868d6697e9e-kube-api-access-hq645\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.563006 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.562995    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-maas-api-tls\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.563241 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.563048    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f45b0e3-04f3-48c5-967a-a868d6697e9e-metrics-certs\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.563241 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.563077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-metrics-certs\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.563241 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.563124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzbzn\" (UniqueName: \"kubernetes.io/projected/aba749c4-8336-4efb-80cd-94b13775b7bf-kube-api-access-wzbzn\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.563965 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.563932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba749c4-8336-4efb-80cd-94b13775b7bf-openshift-service-ca\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.564081 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.563983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f45b0e3-04f3-48c5-967a-a868d6697e9e-openshift-service-ca\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.566754 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.566728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-metrics-certs\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.566864 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.566847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8f45b0e3-04f3-48c5-967a-a868d6697e9e-metrics-certs\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.567236 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.567215    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-maas-api-tls\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.574551 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.574513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq645\" (UniqueName: \"kubernetes.io/projected/8f45b0e3-04f3-48c5-967a-a868d6697e9e-kube-api-access-hq645\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.574631 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.574557    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8f45b0e3-04f3-48c5-967a-a868d6697e9e-maas-api-tls\") pod \"maas-api-5d8898d46d-mncd6\" (UID: \"8f45b0e3-04f3-48c5-967a-a868d6697e9e\") " pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.574696 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.574680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzbzn\" (UniqueName: \"kubernetes.io/projected/aba749c4-8336-4efb-80cd-94b13775b7bf-kube-api-access-wzbzn\") pod \"maas-api-54bb5c4896-n5dll\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") " pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.681912 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.681892    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:07.714730 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.714703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:07.961941 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.961910    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"]
Sep 08 15:30:07.963427 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:30:07.963400    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaba749c4_8336_4efb_80cd_94b13775b7bf.slice/crio-3774b262153778d97077f578906ab4f63d52f63467e2ec4658107893ee1942d2 WatchSource:0}: Error finding container 3774b262153778d97077f578906ab4f63d52f63467e2ec4658107893ee1942d2: Status 404 returned error can't find the container with id 3774b262153778d97077f578906ab4f63d52f63467e2ec4658107893ee1942d2
Sep 08 15:30:07.964729 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.964713    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:30:07.998868 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:07.998844    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"]
Sep 08 15:30:07.999244 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:30:07.999223    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f45b0e3_04f3_48c5_967a_a868d6697e9e.slice/crio-cf9a19a2e891245f0445bdad23cc02fd0c742fb8027728cf91eddf04c37bf546 WatchSource:0}: Error finding container cf9a19a2e891245f0445bdad23cc02fd0c742fb8027728cf91eddf04c37bf546: Status 404 returned error can't find the container with id cf9a19a2e891245f0445bdad23cc02fd0c742fb8027728cf91eddf04c37bf546
Sep 08 15:30:08.717562 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.717469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll" event={"ID":"aba749c4-8336-4efb-80cd-94b13775b7bf","Type":"ContainerStarted","Data":"e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2"}
Sep 08 15:30:08.717562 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.717529    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll" event={"ID":"aba749c4-8336-4efb-80cd-94b13775b7bf","Type":"ContainerStarted","Data":"3774b262153778d97077f578906ab4f63d52f63467e2ec4658107893ee1942d2"}
Sep 08 15:30:08.718044 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.717626    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:08.719254 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.719229    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6" event={"ID":"8f45b0e3-04f3-48c5-967a-a868d6697e9e","Type":"ContainerStarted","Data":"f3030bcdf7f3d1853dce7f2e6593f2912f82c6a3950afe88c48f23a00892bf51"}
Sep 08 15:30:08.719351 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.719268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6" event={"ID":"8f45b0e3-04f3-48c5-967a-a868d6697e9e","Type":"ContainerStarted","Data":"cf9a19a2e891245f0445bdad23cc02fd0c742fb8027728cf91eddf04c37bf546"}
Sep 08 15:30:08.719351 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.719294    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:08.743081 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.743045    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll" podStartSLOduration=1.262051152 podStartE2EDuration="1.743031232s" totalImagesPullingTime="480.98008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:08.741900958 +0000 UTC m=+2099.888921866" watchObservedRunningTime="2026-09-08 15:30:08.743031232 +0000 UTC m=+2099.890052139"
Sep 08 15:30:08.762753 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:08.762715    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6" podStartSLOduration=1.370522438 podStartE2EDuration="1.762702248s" totalImagesPullingTime="392.17981ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:08.762063268 +0000 UTC m=+2099.909084191" watchObservedRunningTime="2026-09-08 15:30:08.762702248 +0000 UTC m=+2099.909723154"
Sep 08 15:30:09.471726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:09.471696    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:30:09.476530 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:09.476500    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:30:09.483680 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:09.483659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:30:09.487939 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:09.487922    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-phr6j_7fb43d0e-8f1b-4d10-981c-122ed0eeaea2/ovn-acl-logging/0.log"
Sep 08 15:30:14.730085 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:14.730058    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5d8898d46d-mncd6"
Sep 08 15:30:14.730501 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:14.730458    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:14.794612 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:14.794580    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"]
Sep 08 15:30:14.794783 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:14.794759    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll" podUID="aba749c4-8336-4efb-80cd-94b13775b7bf" containerName="maas-api" containerID="cri-o://e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2" gracePeriod=30
Sep 08 15:30:15.039084 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.039056    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:15.125104 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.125076    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzbzn\" (UniqueName: \"kubernetes.io/projected/aba749c4-8336-4efb-80cd-94b13775b7bf-kube-api-access-wzbzn\") pod \"aba749c4-8336-4efb-80cd-94b13775b7bf\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") "
Sep 08 15:30:15.125243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.125131    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-metrics-certs\") pod \"aba749c4-8336-4efb-80cd-94b13775b7bf\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") "
Sep 08 15:30:15.125243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.125160    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-maas-api-tls\") pod \"aba749c4-8336-4efb-80cd-94b13775b7bf\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") "
Sep 08 15:30:15.125243 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.125187    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba749c4-8336-4efb-80cd-94b13775b7bf-openshift-service-ca\") pod \"aba749c4-8336-4efb-80cd-94b13775b7bf\" (UID: \"aba749c4-8336-4efb-80cd-94b13775b7bf\") "
Sep 08 15:30:15.125641 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.125605    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aba749c4-8336-4efb-80cd-94b13775b7bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aba749c4-8336-4efb-80cd-94b13775b7bf" (UID: "aba749c4-8336-4efb-80cd-94b13775b7bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:30:15.127137 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.127116    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aba749c4-8336-4efb-80cd-94b13775b7bf-kube-api-access-wzbzn" (OuterVolumeSpecName: "kube-api-access-wzbzn") pod "aba749c4-8336-4efb-80cd-94b13775b7bf" (UID: "aba749c4-8336-4efb-80cd-94b13775b7bf"). InnerVolumeSpecName "kube-api-access-wzbzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:30:15.127246 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.127212    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aba749c4-8336-4efb-80cd-94b13775b7bf" (UID: "aba749c4-8336-4efb-80cd-94b13775b7bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:30:15.127290 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.127278    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aba749c4-8336-4efb-80cd-94b13775b7bf" (UID: "aba749c4-8336-4efb-80cd-94b13775b7bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:30:15.226319 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.226291    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-metrics-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:30:15.226319 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.226317    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aba749c4-8336-4efb-80cd-94b13775b7bf-maas-api-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:30:15.226477 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.226327    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aba749c4-8336-4efb-80cd-94b13775b7bf-openshift-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:30:15.226477 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.226337    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzbzn\" (UniqueName: \"kubernetes.io/projected/aba749c4-8336-4efb-80cd-94b13775b7bf-kube-api-access-wzbzn\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\""
Sep 08 15:30:15.761100 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.761026    2579 generic.go:356] "Generic (PLEG): container finished" podID="aba749c4-8336-4efb-80cd-94b13775b7bf" containerID="e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2" exitCode=0
Sep 08 15:30:15.761100 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.761078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll" event={"ID":"aba749c4-8336-4efb-80cd-94b13775b7bf","Type":"ContainerDied","Data":"e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2"}
Sep 08 15:30:15.761100 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.761082    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"
Sep 08 15:30:15.761632 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.761142    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll" event={"ID":"aba749c4-8336-4efb-80cd-94b13775b7bf","Type":"ContainerDied","Data":"3774b262153778d97077f578906ab4f63d52f63467e2ec4658107893ee1942d2"}
Sep 08 15:30:15.761632 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.761164    2579 scope.go:117] "RemoveContainer" containerID="e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2"
Sep 08 15:30:15.773263 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.772036    2579 scope.go:117] "RemoveContainer" containerID="e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2"
Sep 08 15:30:15.773263 ip-10-0-137-101 kubenswrapper[2579]: E0908 15:30:15.772443    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2\": container with ID starting with e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2 not found: ID does not exist" containerID="e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2"
Sep 08 15:30:15.773263 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.772512    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2"} err="failed to get container status \"e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2\": rpc error: code = NotFound desc = could not find container \"e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2\": container with ID starting with e4a3bdd084566e9f829703276eb1e0f009dca648b7327971fcaf40177dfa09a2 not found: ID does not exist"
Sep 08 15:30:15.780779 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.780757    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"]
Sep 08 15:30:15.785777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:15.785756    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-54bb5c4896-n5dll"]
Sep 08 15:30:17.389018 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:17.388983    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aba749c4-8336-4efb-80cd-94b13775b7bf" path="/var/lib/kubelet/pods/aba749c4-8336-4efb-80cd-94b13775b7bf/volumes"
Sep 08 15:30:46.793155 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:46.793123    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-6l54z_6ce55977-2c4b-4b0b-9baf-85f91217cecd/copy-manifests/0.log"
Sep 08 15:30:46.805218 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:46.805190    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-6l54z_6ce55977-2c4b-4b0b-9baf-85f91217cecd/manager/0.log"
Sep 08 15:30:47.446690 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:47.446651    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5d8898d46d-mncd6_8f45b0e3-04f3-48c5-967a-a868d6697e9e/maas-api/0.log"
Sep 08 15:30:47.924726 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:47.924693    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mn55d_7342e8ad-6bdf-4567-9595-0216ac008d96/postgres/0.log"
Sep 08 15:30:48.981368 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:48.981324    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-mkbjc_b0b8ec63-9843-4291-b195-6b0b6439dbf4/manager/0.log"
Sep 08 15:30:49.105913 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:49.105875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-vwmxb_d636e1e3-1fd4-43b4-8eb2-dc0f616aa695/manager/0.log"
Sep 08 15:30:49.365462 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:49.365383    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-p68x9_465da0ef-c53d-49a2-90f3-50a22b6dfec3/manager/0.log"
Sep 08 15:30:49.645428 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:49.645399    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-bjm7z_70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b/manager/0.log"
Sep 08 15:30:50.156637 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:50.156610    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxhfh_07aee408-9d9e-4798-bfe7-da9c0e58064f/discovery/0.log"
Sep 08 15:30:50.283633 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:50.283608    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff8c49fcd-48fc6_e7204b55-53c3-4863-b768-ab62af7ffb2b/kube-auth-proxy/0.log"
Sep 08 15:30:50.818076 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:50.818043    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dgtj8_e68bc3b2-e101-4f36-ab0d-9c8df0f9340a/payload-processing/0.log"
Sep 08 15:30:51.592571 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:30:51.592544    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-qddrb_5eccdf54-f714-482a-9956-551ccf4a54fc/main/0.log"
Sep 08 15:31:01.406710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:01.406680    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lfnx7_beed6b1a-f32d-44f6-83fc-bbd04306be8c/global-pull-secret-syncer/0.log"
Sep 08 15:31:01.552601 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:01.552572    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qgt4k_89d5f41d-90c3-4008-8a33-838cd3330379/konnectivity-agent/0.log"
Sep 08 15:31:01.673932 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:01.673863    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-101.ec2.internal_0167a65271ebed0b746181fb3621931d/haproxy/0.log"
Sep 08 15:31:06.267923 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:06.267891    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-mkbjc_b0b8ec63-9843-4291-b195-6b0b6439dbf4/manager/0.log"
Sep 08 15:31:06.293481 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:06.293444    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-vwmxb_d636e1e3-1fd4-43b4-8eb2-dc0f616aa695/manager/0.log"
Sep 08 15:31:06.404175 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:06.404150    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-p68x9_465da0ef-c53d-49a2-90f3-50a22b6dfec3/manager/0.log"
Sep 08 15:31:06.522669 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:06.522602    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-bjm7z_70c457fa-68b4-4b3e-bca8-1c17eb7a2d2b/manager/0.log"
Sep 08 15:31:07.971516 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:07.971485    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/alertmanager/0.log"
Sep 08 15:31:08.015055 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.015027    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/config-reloader/0.log"
Sep 08 15:31:08.044276 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.044255    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/kube-rbac-proxy-web/0.log"
Sep 08 15:31:08.065606 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.065586    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/kube-rbac-proxy/0.log"
Sep 08 15:31:08.091678 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.091658    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/kube-rbac-proxy-metric/0.log"
Sep 08 15:31:08.120363 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.120344    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/prom-label-proxy/0.log"
Sep 08 15:31:08.142765 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.142746    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1c0713a2-f2d6-47e3-a640-499918b46949/init-config-reloader/0.log"
Sep 08 15:31:08.317718 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.317654    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c97cd7bfd-v89pr_ddc774e3-961a-4daf-97a7-1163c74dce45/metrics-server/0.log"
Sep 08 15:31:08.506082 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.506060    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmzmb_6cb09e40-7af6-426c-b29c-e26400b4fe39/node-exporter/0.log"
Sep 08 15:31:08.530240 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.530224    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmzmb_6cb09e40-7af6-426c-b29c-e26400b4fe39/kube-rbac-proxy/0.log"
Sep 08 15:31:08.554345 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.554328    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lmzmb_6cb09e40-7af6-426c-b29c-e26400b4fe39/init-textfile/0.log"
Sep 08 15:31:08.704308 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.704285    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-zbgf6_9a0c5c2a-2f29-469a-a3fe-9497e284a04c/kube-rbac-proxy-main/0.log"
Sep 08 15:31:08.736322 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.736302    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-zbgf6_9a0c5c2a-2f29-469a-a3fe-9497e284a04c/kube-rbac-proxy-self/0.log"
Sep 08 15:31:08.757640 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:08.757620    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-zbgf6_9a0c5c2a-2f29-469a-a3fe-9497e284a04c/openshift-state-metrics/0.log"
Sep 08 15:31:09.082651 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.082610    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-nvtjv_797c1a06-8cfd-419b-958b-6f0c9d4593dc/prometheus-operator-admission-webhook/0.log"
Sep 08 15:31:09.211895 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.211869    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bc9f976d8-ftqh2_69cd3712-84f5-4b33-a2a8-4b2b92c30c03/thanos-query/0.log"
Sep 08 15:31:09.237070 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.237037    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bc9f976d8-ftqh2_69cd3712-84f5-4b33-a2a8-4b2b92c30c03/kube-rbac-proxy-web/0.log"
Sep 08 15:31:09.266861 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.266837    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bc9f976d8-ftqh2_69cd3712-84f5-4b33-a2a8-4b2b92c30c03/kube-rbac-proxy/0.log"
Sep 08 15:31:09.298770 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.298752    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bc9f976d8-ftqh2_69cd3712-84f5-4b33-a2a8-4b2b92c30c03/prom-label-proxy/0.log"
Sep 08 15:31:09.331414 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.331397    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bc9f976d8-ftqh2_69cd3712-84f5-4b33-a2a8-4b2b92c30c03/kube-rbac-proxy-rules/0.log"
Sep 08 15:31:09.352592 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:09.352541    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bc9f976d8-ftqh2_69cd3712-84f5-4b33-a2a8-4b2b92c30c03/kube-rbac-proxy-metrics/0.log"
Sep 08 15:31:10.771742 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:10.771711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-92sfl_6290b9f9-de04-4765-89a8-dff0d597ee3f/networking-console-plugin/0.log"
Sep 08 15:31:11.426819 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.426790    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/1.log"
Sep 08 15:31:11.431459 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.431433    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-nz9gb_d6c8521a-181b-4aeb-a655-d0eecb5d7557/console-operator/2.log"
Sep 08 15:31:11.629119 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.629086    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"]
Sep 08 15:31:11.629522 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.629506    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aba749c4-8336-4efb-80cd-94b13775b7bf" containerName="maas-api"
Sep 08 15:31:11.629576 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.629523    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aba749c4-8336-4efb-80cd-94b13775b7bf" containerName="maas-api"
Sep 08 15:31:11.629618 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.629590    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aba749c4-8336-4efb-80cd-94b13775b7bf" containerName="maas-api"
Sep 08 15:31:11.634165 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.634146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.637007 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.636989    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5z7hh\"/\"default-dockercfg-8ph62\""
Sep 08 15:31:11.637755 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.637734    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5z7hh\"/\"kube-root-ca.crt\""
Sep 08 15:31:11.637755 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.637747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5z7hh\"/\"openshift-service-ca.crt\""
Sep 08 15:31:11.644979 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.644957    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"]
Sep 08 15:31:11.778255 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.778189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-podres\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.778255 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.778220    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgwfv\" (UniqueName: \"kubernetes.io/projected/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-kube-api-access-mgwfv\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.778255 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.778239    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-proc\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.778696 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.778261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-lib-modules\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.778696 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.778348    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-sys\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879296 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879269    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-podres\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgwfv\" (UniqueName: \"kubernetes.io/projected/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-kube-api-access-mgwfv\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-proc\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-lib-modules\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879397    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-sys\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879436 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879423    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-podres\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879489    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-proc\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879515    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-sys\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.879687 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.879546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-lib-modules\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.888591 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.888574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgwfv\" (UniqueName: \"kubernetes.io/projected/2fcc0422-f46c-4f64-8804-ae4c1eda6a60-kube-api-access-mgwfv\") pod \"perf-node-gather-daemonset-kmkdd\" (UID: \"2fcc0422-f46c-4f64-8804-ae4c1eda6a60\") " pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:11.944525 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:11.944507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:12.030164 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:12.030088    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8547cb958b-s9mw6_01274068-2ccf-4dac-8527-be28f9996f8e/console/0.log"
Sep 08 15:31:12.217777 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:12.217753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"]
Sep 08 15:31:12.219620 ip-10-0-137-101 kubenswrapper[2579]: W0908 15:31:12.219592    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2fcc0422_f46c_4f64_8804_ae4c1eda6a60.slice/crio-a5d11931afa8dc5703b5d8e4c9e946aa760491b0d5842f8ce89f620d4ca9f3b8 WatchSource:0}: Error finding container a5d11931afa8dc5703b5d8e4c9e946aa760491b0d5842f8ce89f620d4ca9f3b8: Status 404 returned error can't find the container with id a5d11931afa8dc5703b5d8e4c9e946aa760491b0d5842f8ce89f620d4ca9f3b8
Sep 08 15:31:12.777710 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:12.777679    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-kzdg4_a80d12c9-5c6d-4a0f-8168-d1d717e1e2e3/volume-data-source-validator/0.log"
Sep 08 15:31:13.094010 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:13.093925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd" event={"ID":"2fcc0422-f46c-4f64-8804-ae4c1eda6a60","Type":"ContainerStarted","Data":"12d41fc71eb81a375102f3924ce9412843350f0dbbab4d35f2c8eb8b2aefcb45"}
Sep 08 15:31:13.094010 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:13.093974    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd" event={"ID":"2fcc0422-f46c-4f64-8804-ae4c1eda6a60","Type":"ContainerStarted","Data":"a5d11931afa8dc5703b5d8e4c9e946aa760491b0d5842f8ce89f620d4ca9f3b8"}
Sep 08 15:31:13.094010 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:13.094002    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:13.113815 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:13.113767    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd" podStartSLOduration=2.113752018 podStartE2EDuration="2.113752018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:31:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:13.111239203 +0000 UTC m=+2164.258260114" watchObservedRunningTime="2026-09-08 15:31:13.113752018 +0000 UTC m=+2164.260772925"
Sep 08 15:31:13.928279 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:13.928246    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5shh_02abfb67-4e49-4073-80e2-faa480dfb423/dns/0.log"
Sep 08 15:31:13.953868 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:13.953842    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-q5shh_02abfb67-4e49-4073-80e2-faa480dfb423/kube-rbac-proxy/0.log"
Sep 08 15:31:14.086352 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:14.086325    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g4pjk_4358d9ec-fe9c-4e92-9ec0-84c7bf057cac/dns-node-resolver/0.log"
Sep 08 15:31:14.745757 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:14.745729    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-hpggd_1c2932f0-81e5-4cea-812f-122a0cea9375/node-ca/0.log"
Sep 08 15:31:16.106108 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:16.106078    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxhfh_07aee408-9d9e-4798-bfe7-da9c0e58064f/discovery/0.log"
Sep 08 15:31:16.139298 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:16.139271    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff8c49fcd-48fc6_e7204b55-53c3-4863-b768-ab62af7ffb2b/kube-auth-proxy/0.log"
Sep 08 15:31:16.332414 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:16.332387    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dgtj8_e68bc3b2-e101-4f36-ab0d-9c8df0f9340a/payload-processing/0.log"
Sep 08 15:31:17.429360 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:17.429332    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xq9kj_91357713-dbb0-4d33-b2a0-059b45b22fd1/serve-healthcheck-canary/0.log"
Sep 08 15:31:18.067741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:18.067711    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-ngsg5_71db9847-e1f3-42dc-a9a6-1fb48e7e6624/insights-operator/0.log"
Sep 08 15:31:18.067741 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:18.067735    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-ngsg5_71db9847-e1f3-42dc-a9a6-1fb48e7e6624/insights-operator/1.log"
Sep 08 15:31:18.104806 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:18.104782    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nztf_254ae859-7b70-497f-bfe2-62fab5897af4/kube-rbac-proxy/0.log"
Sep 08 15:31:18.141609 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:18.141585    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nztf_254ae859-7b70-497f-bfe2-62fab5897af4/exporter/0.log"
Sep 08 15:31:18.189086 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:18.189061    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5nztf_254ae859-7b70-497f-bfe2-62fab5897af4/extractor/0.log"
Sep 08 15:31:19.108924 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:19.108899    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5z7hh/perf-node-gather-daemonset-kmkdd"
Sep 08 15:31:21.736371 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:21.736292    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-6l54z_6ce55977-2c4b-4b0b-9baf-85f91217cecd/manager/0.log"
Sep 08 15:31:21.809662 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:21.809637    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b574fc88f-6l54z_6ce55977-2c4b-4b0b-9baf-85f91217cecd/copy-manifests/0.log"
Sep 08 15:31:22.310297 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:22.310267    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxhfh_07aee408-9d9e-4798-bfe7-da9c0e58064f/discovery/0.log"
Sep 08 15:31:22.386856 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:22.386828    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff8c49fcd-48fc6_e7204b55-53c3-4863-b768-ab62af7ffb2b/kube-auth-proxy/0.log"
Sep 08 15:31:22.679652 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:22.679626    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dgtj8_e68bc3b2-e101-4f36-ab0d-9c8df0f9340a/payload-processing/0.log"
Sep 08 15:31:24.738627 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:24.738595    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-rxhfh_07aee408-9d9e-4798-bfe7-da9c0e58064f/discovery/0.log"
Sep 08 15:31:24.811912 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:24.811882    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5ff8c49fcd-48fc6_e7204b55-53c3-4863-b768-ab62af7ffb2b/kube-auth-proxy/0.log"
Sep 08 15:31:25.103500 ip-10-0-137-101 kubenswrapper[2579]: I0908 15:31:25.103431    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-dgtj8_e68bc3b2-e101-4f36-ab0d-9c8df0f9340a/payload-processing/0.log"