Aug 04 15:04:36.456835 ip-10-0-137-247 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 15:04:36.456847 ip-10-0-137-247 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 15:04:36.456856 ip-10-0-137-247 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 15:04:36.457233 ip-10-0-137-247 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 15:04:46.576742 ip-10-0-137-247 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 15:04:46.576761 ip-10-0-137-247 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 993929d2f8b14e23ae7355274a6a4dc5 --
Aug 04 15:06:24.182394 ip-10-0-137-247 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 15:06:24.622012 ip-10-0-137-247 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 15:06:24.622012 ip-10-0-137-247 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 15:06:24.622012 ip-10-0-137-247 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 15:06:24.622012 ip-10-0-137-247 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 15:06:24.622012 ip-10-0-137-247 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 15:06:24.625028 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.624869    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 15:06:24.629209 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629195    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:24.629209 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629209    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629213    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629216    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629219    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629222    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629225    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629228    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629231    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629233    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629236    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629239    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629241    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629244    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629246    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629249    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629252    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629255    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629258    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629262    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:24.629273 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629266    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629270    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629273    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629275    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629278    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629282    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629285    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629287    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629290    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629293    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629295    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629298    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629301    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629304    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629306    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629309    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629312    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629314    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629317    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629319    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:24.629758 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629324    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629327    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629330    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629333    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629335    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629338    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629340    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629343    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629345    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629348    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629351    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629354    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629356    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629359    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629363    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629366    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629368    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629372    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629376    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:24.630336 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629379    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629382    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629385    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629388    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629391    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629393    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629396    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629399    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629401    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629404    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629406    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629409    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629411    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629414    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629416    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629420    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629422    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629425    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629427    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629430    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:24.630802 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629432    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629435    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629438    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629440    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629443    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629446    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629449    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629452    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629455    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629457    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629460    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629463    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629465    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629468    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629470    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629473    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629476    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629478    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629481    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.629483    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:24.631299 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630220    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630227    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630230    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630232    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630235    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630238    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630240    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630243    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630245    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630247    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630250    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630253    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630255    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630258    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630261    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630264    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630267    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630270    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630273    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630275    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:24.631785 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630278    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630281    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630283    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630285    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630288    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630290    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630292    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630295    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630297    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630299    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630302    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630304    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630307    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630309    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630312    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630314    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630316    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630319    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630321    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630324    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:24.632328 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630326    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630329    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630331    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630334    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630336    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630341    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630344    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630348    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630351    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630354    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630357    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630362    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630365    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630368    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630371    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630374    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630377    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630379    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630382    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:24.632809 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630385    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630387    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630390    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630392    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630395    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630398    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630400    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630403    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630405    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630408    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630411    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630413    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630416    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630418    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630421    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630423    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630427    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630429    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630432    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630435    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:24.633295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630438    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630440    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630443    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630446    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630449    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630452    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630455    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630459    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630462    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630465    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630467    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630470    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630472    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630475    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630477    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630480    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630482    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630484    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630487    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:24.633775 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630489    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630843    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630848    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630852    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630854    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630857    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630859    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630862    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630864    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630867    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630870    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630872    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630875    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630877    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630880    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630883    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630885    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630889    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630892    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630894    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630897    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:24.634256 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630899    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630902    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630905    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630908    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630911    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630913    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630916    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630918    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630921    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630923    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630926    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630928    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630931    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630933    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630936    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630940    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630943    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630946    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630949    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:24.634767 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630951    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630954    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630957    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630960    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630962    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630965    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630967    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630969    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630972    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630974    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630977    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630980    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630982    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630985    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630989    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630992    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630995    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.630997    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631000    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:24.635253 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631003    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631005    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631008    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631011    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631013    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631030    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631033    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631036    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631038    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631041    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631044    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631046    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631049    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631051    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631054    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631056    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631058    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631061    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631065    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631067    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:24.635729 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631070    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631072    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631075    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631077    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631081    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631083    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631086    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631089    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631091    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631094    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631096    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631099    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631101    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631103    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631106    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631108    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631111    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631113    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631116    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631118    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:24.636236 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631121    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631191    2581 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631202    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631207    2581 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631211    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631215    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631218    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631223    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631227    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631230    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631233    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631236    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631239    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631242    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631245    2581 flags.go:64] FLAG: --cgroup-root=""
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631248    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631251    2581 flags.go:64] FLAG: --client-ca-file=""
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631255    2581 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631258    2581 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631262    2581 flags.go:64] FLAG: --cluster-domain=""
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631265    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631267    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631271    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631274    2581 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 15:06:24.636717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631277    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631280    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631286    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631289    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631292    2581 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631295    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631298    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631301    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631304    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631309    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631312    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631315    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631318    2581 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631321    2581 flags.go:64] FLAG: --enable-server="true"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631324    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631327    2581 flags.go:64] FLAG: --event-burst="100"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631330    2581 flags.go:64] FLAG: --event-qps="50"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631333    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631336    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631339    2581 flags.go:64] FLAG: --eviction-hard=""
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631345    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631348    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631351    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631354    2581 flags.go:64] FLAG: --eviction-soft=""
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631357    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 15:06:24.637311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631360    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631364    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631366    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631369    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631372    2581 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631375    2581 flags.go:64] FLAG: --feature-gates=""
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631379    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631382    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631385    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631389    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631392    2581 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631395    2581 flags.go:64] FLAG: --help="false"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631398    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631401    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631404    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631406    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631410    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631413    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631416    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631419    2581 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631422    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631425    2581 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631427    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631431    2581 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 15:06:24.637943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631433    2581 flags.go:64] FLAG: --kube-reserved=""
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631436    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631438    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631443    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631445    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631448    2581 flags.go:64] FLAG: --lock-file=""
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631451    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631454    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631456    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631462    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631465    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631468    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631471    2581 flags.go:64] FLAG: --logging-format="text"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631473    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631477    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631479    2581 flags.go:64] FLAG: --manifest-url=""
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631482    2581 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631487    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631490    2581 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631494    2581 flags.go:64] FLAG: --max-pods="110"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631497    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631500    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631503    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631506    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631509    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 15:06:24.638562 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631512    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631515    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631521    2581 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631524    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631527    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631530    2581 flags.go:64] FLAG: --pod-cidr=""
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631533    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631539    2581 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631542    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631545    2581 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631549    2581 flags.go:64] FLAG: --port="10250"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631552    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631555    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e91a5ecbc5c4b2f3"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631558    2581 flags.go:64] FLAG: --qos-reserved=""
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631561    2581 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631564    2581 flags.go:64] FLAG: --register-node="true"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631567    2581 flags.go:64] FLAG: --register-with-taints=""
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631571    2581 flags.go:64] FLAG: --registry-burst="10"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631574    2581 flags.go:64] FLAG: --registry-qps="5"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631577    2581 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631580    2581 flags.go:64] FLAG: --reserved-memory=""
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631584    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631586    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631589    2581 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631592    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 15:06:24.639219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631596    2581 flags.go:64] FLAG: --runonce="false"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631599    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631602    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631605    2581 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631608    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631611    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631614    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631617    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631620    2581 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631622    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631625    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631628    2581 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631631    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631634    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631637    2581 flags.go:64] FLAG: --system-cgroups=""
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631640    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631645    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631649    2581 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631651    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631655    2581 flags.go:64] FLAG: --tls-min-version=""
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631658    2581 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631661    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631663    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631666    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631669    2581 flags.go:64] FLAG: --v="2"
Aug 04 15:06:24.639823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631677    2581 flags.go:64] FLAG: --version="false"
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631681    2581 flags.go:64] FLAG: --vmodule=""
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631684    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.631687    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631802    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631806    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631809    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631815    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631817    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631820    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631823    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631826    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631828    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631831    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631833    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631835    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631838    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631840    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631843    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631845    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:24.640438 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631847    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631850    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631853    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631855    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631860    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631862    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631864    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631867    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631869    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631872    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631874    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631877    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631879    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631881    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631888    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631891    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631894    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631896    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631899    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631902    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:24.640936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631905    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631907    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631910    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631912    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631915    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631917    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631919    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631922    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631924    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631926    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631929    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631931    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631933    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631936    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631938    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631940    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631949    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631953    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631956    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:24.641460 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631959    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631963    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631967    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631971    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631974    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631977    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631979    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631983    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631986    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631988    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631991    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631993    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631997    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.631999    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632002    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632005    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632007    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632010    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632012    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:24.641929 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632029    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632031    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632034    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632037    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632039    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632042    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632044    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632047    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632049    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632052    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632055    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632058    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632060    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632063    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632065    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632068    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632071    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632073    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632075    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632078    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:24.642403 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632080    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:24.642881 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632084    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:24.642881 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632087    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:24.642881 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632089    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:24.642881 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.632092    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:24.642881 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.632890    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 15:06:24.649802 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.649779    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 15:06:24.649802 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.649798    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.649818    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.649828    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649888    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649892    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649895    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649899    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649902    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649905    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649908    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649911    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649915    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649918    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649920    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649923    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649926    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649930    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:24.649924 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649933    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649936    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649939    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649941    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649944    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649948    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649951    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649954    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649956    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649959    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649968    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649971    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649973    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649976    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649978    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649981    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649983    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649986    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649988    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649991    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:24.650358 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649993    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649996    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.649998    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650001    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650003    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650006    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650008    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650010    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650013    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650027    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650029    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650032    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650034    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650039    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650044    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650047    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650050    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650053    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650056    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650058    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:24.650851 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650061    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650064    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650067    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650070    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650072    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650075    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650077    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650080    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650082    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650085    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650088    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650091    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650095    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650098    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650101    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650104    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650107    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650110    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650112    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:24.651390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650115    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650117    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650120    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650122    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650125    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650127    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650131    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650134    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650136    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650139    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650141    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650144    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650146    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650149    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650151    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650154    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650156    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650159    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650161    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650164    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:24.651840 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650166    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650168    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650171    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650173    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650176    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650180    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.650186    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650303    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650309    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650312    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650315    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650318    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650321    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650323    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650326    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:24.652353 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650329    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650331    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650334    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650336    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650339    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650342    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650345    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650347    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650350    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650352    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650355    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650357    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650360    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650363    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650365    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650368    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650370    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650373    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650377    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650381    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:24.652721 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650384    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650387    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650389    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650392    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650394    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650396    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650399    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650401    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650404    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650406    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650409    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650411    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650414    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650416    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650419    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650421    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650424    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650427    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650430    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:24.653261 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650432    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650435    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650437    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650440    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650442    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650445    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650447    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650449    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650452    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650454    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650457    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650459    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650461    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650464    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650467    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650471    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650474    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650477    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650480    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:24.653730 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650482    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650485    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650487    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650489    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650492    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650494    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650497    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650500    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650502    2581 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650505    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650508    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650511    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650514    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650516    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650518    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650521    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650523    2581 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650526    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650528    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650530    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:24.654212 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650534    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650538    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650540    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650543    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650546    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650549    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650551    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650554    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650557    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650560    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650562    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650565    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:24.650568    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.650573    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 15:06:24.654692 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.650689    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 15:06:24.655811 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.655796    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 15:06:24.657454 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.657441    2581 server.go:1019] "Starting client certificate rotation"
Aug 04 15:06:24.657570 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.657550    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 15:06:24.657629 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.657592    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 15:06:24.660307 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.660291    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 15:06:24.661608 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.661587    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 15:06:24.670638 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.670622    2581 log.go:25] "Validated CRI v1 runtime API"
Aug 04 15:06:24.672971 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.672956    2581 log.go:25] "Validated CRI v1 image API"
Aug 04 15:06:24.673767 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.673756    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 15:06:24.677238 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.677214    2581 fs.go:135] Filesystem UUIDs: map[1335bf33-f6e1-4d55-b474-4aabbaef0d95:/dev/nvme0n1p4 76652315-be0d-4afe-ab48-9103d7279979:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Aug 04 15:06:24.677297 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.677237    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 15:06:24.683057 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.682931    2581 manager.go:216] Machine: {Timestamp:2026-08-04 15:06:24.682460562 +0000 UTC m=+0.370984986 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2969923 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28e2c0087cab04da2b6d172400a5fd SystemUUID:ec28e2c0-087c-ab04-da2b-6d172400a5fd BootID:993929d2-f8b1-4e23-ae73-55274a6a4dc5 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c0:d8:c5:55:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c0:d8:c5:55:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:7a:1a:63:54:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 15:06:24.683057 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.683048    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 15:06:24.683202 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.683120    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 15:06:24.686853 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.686825    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 15:06:24.687014 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.686859    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-247.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 15:06:24.687723 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.687710    2581 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 15:06:24.687774 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.687729    2581 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 15:06:24.687774 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.687740    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 15:06:24.687774 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.687755    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 15:06:24.689127 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.689114    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 15:06:24.694604 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.694590    2581 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 15:06:24.694734 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.694723    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 15:06:24.695586 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.695575    2581 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 15:06:24.695649 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.695593    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 15:06:24.695649 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.695612    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 15:06:24.695649 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.695624    2581 kubelet.go:398] "Adding apiserver pod source"
Aug 04 15:06:24.695649 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.695638    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 15:06:24.696035 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.696005    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 15:06:24.696101 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.696048    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 15:06:24.699784 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.699767    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 15:06:24.700399 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.700380    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 15:06:24.701503 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.701489    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 15:06:24.701561 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.701519    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 15:06:24.702949 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.702937    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 15:06:24.702991 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.702956    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 15:06:24.702991 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.702967    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 15:06:24.702991 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.702976    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 15:06:24.702991 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.702989    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.702995    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.703003    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.703008    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.703014    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.703032    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.703040    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 15:06:24.703133 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.703046    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 15:06:24.704791 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.704781    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 15:06:24.704791 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.704790    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 15:06:24.708591 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.708577    2581 server.go:1268] "Started kubelet"
Aug 04 15:06:24.708693 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.708665    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 15:06:24.708744 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.708662    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 15:06:24.708744 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.708737    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 15:06:24.709419 ip-10-0-137-247 systemd[1]: Started Kubernetes Kubelet.
Aug 04 15:06:24.710305 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.710206    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 15:06:24.710852 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.710834    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-247.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 15:06:24.711439 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.711426    2581 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 15:06:24.711521 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.711487    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 15:06:24.711521 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.711491    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 15:06:24.713984 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.713963    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 15:06:24.719509 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.719486    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 15:06:24.719509 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.719493    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 15:06:24.719624 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.719585    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:24.720332 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720314    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 15:06:24.720332 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720334    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720314    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720335    2581 factory.go:55] Registering systemd factory
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720360    2581 factory.go:223] Registration of the systemd container factory successfully
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720462    2581 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720471    2581 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720531    2581 factory.go:153] Registering CRI-O factory
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720545    2581 factory.go:223] Registration of the crio container factory successfully
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720600    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720626    2581 factory.go:103] Registering Raw factory
Aug 04 15:06:24.720643 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720637    2581 manager.go:1196] Started watching for new ooms in manager
Aug 04 15:06:24.721077 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.720969    2581 manager.go:349] Starting recovery of all containers
Aug 04 15:06:24.733493 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.733406    2581 manager.go:354] Recovery completed
Aug 04 15:06:24.734978 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.734958    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Aug 04 15:06:24.735806 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.735773    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-247.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 15:06:24.735893 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.735820    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 15:06:24.736879 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.735773    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e648efe98  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.708550296 +0000 UTC m=+0.397074720,LastTimestamp:2026-08-04 15:06:24.708550296 +0000 UTC m=+0.397074720,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.737977 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.737965    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.739756 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.739741    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.739802 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.739770    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.739802 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.739781    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.740311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740290    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 15:06:24.740311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740306    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 15:06:24.740424 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740316    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.740424 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740324    2581 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 15:06:24.740920 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740904    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.740970 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740927    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.740970 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.740937    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.742511 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.742487    2581 policy_none.go:49] "None policy: Start"
Aug 04 15:06:24.742511 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.742502    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 15:06:24.742511 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.742511    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 15:06:24.744420 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.744410    2581 policy_none.go:47] "Start"
Aug 04 15:06:24.752693 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.752623    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e666b2b87  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.739756935 +0000 UTC m=+0.428281359,LastTimestamp:2026-08-04 15:06:24.739756935 +0000 UTC m=+0.428281359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.766117 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.765892    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e666b7155  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.739774805 +0000 UTC m=+0.428299229,LastTimestamp:2026-08-04 15:06:24.739774805 +0000 UTC m=+0.428299229,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.770352 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.770281    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e666b98c0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.739784896 +0000 UTC m=+0.428309320,LastTimestamp:2026-08-04 15:06:24.739784896 +0000 UTC m=+0.428309320,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.774411 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.774314    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-247.ec2.internal.18c8a28e666b2b87\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e666b2b87  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.739756935 +0000 UTC m=+0.428281359,LastTimestamp:2026-08-04 15:06:24.740916703 +0000 UTC m=+0.429441126,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.775807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.775787    2581 manager.go:337] "Starting Device Plugin manager"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.775846    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.775859    2581 server.go:87] "Starting device plugin registration server"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.776219    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.776234    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.776439    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.776541    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.776550    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.777047    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.777120    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.778685    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-247.ec2.internal.18c8a28e666b7155\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e666b7155  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.739774805 +0000 UTC m=+0.428299229,LastTimestamp:2026-08-04 15:06:24.740931876 +0000 UTC m=+0.429456300,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.802598 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.788112    2581 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-247.ec2.internal.18c8a28e666b98c0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e666b98c0  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-247.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.739784896 +0000 UTC m=+0.428309320,LastTimestamp:2026-08-04 15:06:24.74094113 +0000 UTC m=+0.429465554,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.803412 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.803333    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-247.ec2.internal.18c8a28e6962c360  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-247.ec2.internal,UID:ip-10-0-137-247.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-137-247.ec2.internal,},FirstTimestamp:2026-08-04 15:06:24.789537632 +0000 UTC m=+0.478062043,LastTimestamp:2026-08-04 15:06:24.789537632 +0000 UTC m=+0.478062043,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-247.ec2.internal,}"
Aug 04 15:06:24.814525 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.814491    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d57rx"
Aug 04 15:06:24.820978 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.820949    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 15:06:24.822377 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.822360    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 15:06:24.822471 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.822399    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 15:06:24.822471 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.822428    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 15:06:24.822571 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.822471    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 15:06:24.828288 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.828263    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d57rx"
Aug 04 15:06:24.828435 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.828348    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Aug 04 15:06:24.877234 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.877163    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.878075 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.878058    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.878156 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.878089    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.878156 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.878099    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.878156 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.878124    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.904391 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.904368    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.904391 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.904392    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-247.ec2.internal\": node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:24.922844 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.922819    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"]
Aug 04 15:06:24.922952 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.922878    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.923675 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.923651    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.923782 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.923682    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.923782 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.923692    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.926086 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926073    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.926216 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926196    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.926252 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926244    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.926762 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926738    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.926762 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926757    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.926878 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926771    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.926878 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926776    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.926878 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926782    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.926878 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.926787    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.929009 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.928994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.929101 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.929035    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:24.929705 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.929691    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:24.929793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.929720    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:24.929793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:24.929733    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:24.943604 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.943584    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-247.ec2.internal\" not found" node="ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.948136 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.948121    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-247.ec2.internal\" not found" node="ip-10-0-137-247.ec2.internal"
Aug 04 15:06:24.951837 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:24.951823    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.022667 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.022632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bab3e87aa201c92a5c8e9edbf625e72a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"bab3e87aa201c92a5c8e9edbf625e72a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.022667 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.022664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bab3e87aa201c92a5c8e9edbf625e72a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"bab3e87aa201c92a5c8e9edbf625e72a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.022865 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.022686    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3768d099968536462897c691c261bff2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-247.ec2.internal\" (UID: \"3768d099968536462897c691c261bff2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.052355 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.052327    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.123127 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.123097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bab3e87aa201c92a5c8e9edbf625e72a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"bab3e87aa201c92a5c8e9edbf625e72a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.123185 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.123129    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bab3e87aa201c92a5c8e9edbf625e72a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"bab3e87aa201c92a5c8e9edbf625e72a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.123185 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.123145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3768d099968536462897c691c261bff2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-247.ec2.internal\" (UID: \"3768d099968536462897c691c261bff2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.123247 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.123195    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3768d099968536462897c691c261bff2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-247.ec2.internal\" (UID: \"3768d099968536462897c691c261bff2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.123247 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.123202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bab3e87aa201c92a5c8e9edbf625e72a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"bab3e87aa201c92a5c8e9edbf625e72a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.123247 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.123230    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bab3e87aa201c92a5c8e9edbf625e72a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal\" (UID: \"bab3e87aa201c92a5c8e9edbf625e72a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.153066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.153000    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.246370 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.246332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.252171 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.252074    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:25.253134 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.253116    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.354062 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.354009    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.454658 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.454621    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.555261 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.555222    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.574866 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.574844    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:25.655525 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.655499    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.656577 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.656559    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 15:06:25.656722 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.656698    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 15:06:25.756555 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.756444    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.799168 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.799138    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:25.834088 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.834053    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 15:01:26 +0000 UTC" deadline="2028-01-06 05:05:50.909390965 +0000 UTC"
Aug 04 15:06:25.834088 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.834084    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12469h59m25.07530963s"
Aug 04 15:06:25.857229 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.857198    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:25.888067 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:25.888012    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3768d099968536462897c691c261bff2.slice/crio-700efa577cab1c2e0b694bfab1d7f11625ffbc3c78ab9adf8d7bc2d2f6c9aa46 WatchSource:0}: Error finding container 700efa577cab1c2e0b694bfab1d7f11625ffbc3c78ab9adf8d7bc2d2f6c9aa46: Status 404 returned error can't find the container with id 700efa577cab1c2e0b694bfab1d7f11625ffbc3c78ab9adf8d7bc2d2f6c9aa46
Aug 04 15:06:25.893557 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.893540    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:06:25.950493 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.950462    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:25.951729 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.951713    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:25.951803 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.951745    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:25.951803 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:25.951759    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:25.957989 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:25.957973    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:26.059133 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:26.059050    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-247.ec2.internal\" not found"
Aug 04 15:06:27.616670 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:27.616647    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:27.693650 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:27.693605    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:27.712236 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:27.712214    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 15:06:27.713770 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:27.713757    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal"
Aug 04 15:06:27.727215 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:27.727187    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 15:06:27.737778 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:27.737753    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:27.912593 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:27.912566    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab3e87aa201c92a5c8e9edbf625e72a.slice/crio-d3411314fc68f637bfe586027f5e7c4dff756625e7699028d7ec379bb2f3f544 WatchSource:0}: Error finding container d3411314fc68f637bfe586027f5e7c4dff756625e7699028d7ec379bb2f3f544: Status 404 returned error can't find the container with id d3411314fc68f637bfe586027f5e7c4dff756625e7699028d7ec379bb2f3f544
Aug 04 15:06:28.169736 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.169658    2581 apiserver.go:52] "Watching apiserver"
Aug 04 15:06:28.178459 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.178423    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 15:06:28.178917 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.178888    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-jh8wj","kube-system/global-pull-secret-syncer-mtnjh","openshift-dns/node-resolver-9kf6d","openshift-multus/multus-additional-cni-plugins-ngrnw","openshift-network-diagnostics/network-check-target-r9n6s","openshift-network-operator/iptables-alerter-nq4zr","openshift-ovn-kubernetes/ovnkube-node-flfvl","kube-system/konnectivity-agent-xq2ng","kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7","openshift-cluster-node-tuning-operator/tuned-jz2dv","openshift-image-registry/node-ca-vn8zq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal","openshift-multus/multus-wq5s8"]
Aug 04 15:06:28.181664 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.181634    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.184055 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.184028    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.186623 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.186602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.188989 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.188967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.191304 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.191272    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:28.191402 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.191355    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:28.193844 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.193826    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 15:06:28.194270 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.194245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.196867 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.196460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.198908 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.198886    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.203807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.203779    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.203913 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.203861    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:28.205367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwlt6\" (UniqueName: \"kubernetes.io/projected/69196957-9b66-415e-a184-bcb4109b987b-kube-api-access-vwlt6\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.205480 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-systemd-units\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205480 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-cni-netd\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205480 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-ovnkube-config\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205480 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205457    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-env-overrides\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-modprobe-d\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205502    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysctl-d\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-var-lib-kubelet\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-os-release\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-kubelet\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-ovn\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.205707 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205702    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-cni-bin\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205756    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crnkz\" (UniqueName: \"kubernetes.io/projected/62a896c1-c68a-473e-abda-f4c1486c4281-kube-api-access-crnkz\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-kubernetes\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205839    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysctl-conf\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-sys\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-lib-modules\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205922    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-var-lib-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-host\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.205989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-tuned\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cf4fcd6-e1bb-460c-a875-713dd6476858-tmp\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgbcf\" (UniqueName: \"kubernetes.io/projected/4cf4fcd6-e1bb-460c-a875-713dd6476858-kube-api-access-pgbcf\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48028eed-5735-4146-a227-19f187a5af5f-hosts-file\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-system-cni-dir\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69196957-9b66-415e-a184-bcb4109b987b-host-slash\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.206176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-slash\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-log-socket\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-run-ovn-kubernetes\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48028eed-5735-4146-a227-19f187a5af5f-tmp-dir\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b849\" (UniqueName: \"kubernetes.io/projected/c48bca2c-b24e-4ed6-8b84-c2774186e491-kube-api-access-9b849\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-run-netns\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206344    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-systemd\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206424    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62a896c1-c68a-473e-abda-f4c1486c4281-ovn-node-metrics-cert\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-systemd\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-run\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-cnibin\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206522    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69196957-9b66-415e-a184-bcb4109b987b-iptables-alerter-script\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.206876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-etc-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.207313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206681    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-ovnkube-script-lib\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.207313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysconfig\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.207313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.207313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.207313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-node-log\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.207313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.206826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hghng\" (UniqueName: \"kubernetes.io/projected/48028eed-5735-4146-a227-19f187a5af5f-kube-api-access-hghng\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.208970 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.208851    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.208970 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.208923    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:28.211295 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211271    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.211416 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211361    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 15:06:28.211416 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211377    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.211525 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211442    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.211694 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211676    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 15:06:28.211743 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211703    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 15:06:28.211812 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211800    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 15:06:28.211846 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211825    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.211846 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.211831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 15:06:28.212874 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.212856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.212971 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.212886    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 15:06:28.213030 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.212975    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.213129 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.213114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c2z6b\""
Aug 04 15:06:28.213197 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.213143    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.213249 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.213116    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 15:06:28.214789 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.214200    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m44fs\""
Aug 04 15:06:28.214789 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.214235    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 15:06:28.214789 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.214322    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jdfj\""
Aug 04 15:06:28.214789 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.214422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 15:06:28.214789 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.214547    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 15:06:28.215214 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.215196    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-86xsr\""
Aug 04 15:06:28.215435 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.215415    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 15:06:28.215550 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.215512    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.215692 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.215666    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pcw5k\""
Aug 04 15:06:28.215891 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.215871    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bm984\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.216063    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.216506    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.216783    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q8hkz\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.216969    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.217144    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.217326    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.217482    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.217872 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.217729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-95nvc\""
Aug 04 15:06:28.219499 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.218638    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 15:06:28.219499 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.218928    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 15:06:28.220971 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.220775    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 15:06:28.220971 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.220784    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-krpq7\""
Aug 04 15:06:28.231928 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.231900    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 15:06:28.294730 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.294703    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 15:06:28.302569 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.302497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"bab3e87aa201c92a5c8e9edbf625e72a","Type":"ContainerStarted","Data":"d3411314fc68f637bfe586027f5e7c4dff756625e7699028d7ec379bb2f3f544"}
Aug 04 15:06:28.303634 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.303608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" event={"ID":"3768d099968536462897c691c261bff2","Type":"ContainerStarted","Data":"700efa577cab1c2e0b694bfab1d7f11625ffbc3c78ab9adf8d7bc2d2f6c9aa46"}
Aug 04 15:06:28.307857 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.307834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d945a800-d054-4e6a-9d7c-d902407d676d-cni-binary-copy\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.307961 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.307865    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-hostroot\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.307961 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.307883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.307961 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.307907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.307961 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.307937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69196957-9b66-415e-a184-bcb4109b987b-host-slash\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.308132 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.307975    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-log-socket\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308132 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69196957-9b66-415e-a184-bcb4109b987b-host-slash\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.308132 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-run-ovn-kubernetes\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308132 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-log-socket\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308132 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de1c4cc2-9902-431e-828b-f26f2f680113-host\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-run-ovn-kubernetes\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-os-release\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-sys-fs\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-run-netns\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-systemd\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.308317 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308328    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-run-netns\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308370    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-socket-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308499    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-systemd\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-ovnkube-script-lib\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308568    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.308607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-multus-certs\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.308852 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/accd62b8-2240-4a4d-a798-d0b60190dd70-agent-certs\") pod \"konnectivity-agent-xq2ng\" (UID: \"accd62b8-2240-4a4d-a798-d0b60190dd70\") " pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.308852 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.308916 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308857    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/accd62b8-2240-4a4d-a798-d0b60190dd70-konnectivity-ca\") pod \"konnectivity-agent-xq2ng\" (UID: \"accd62b8-2240-4a4d-a798-d0b60190dd70\") " pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.308916 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-etc-selinux\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.308916 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308903    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hghng\" (UniqueName: \"kubernetes.io/projected/48028eed-5735-4146-a227-19f187a5af5f-kube-api-access-hghng\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.309012 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308930    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-system-cni-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.309012 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308946    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-kubelet\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.309012 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-conf-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.309012 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.309145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.308977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-cni-netd\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.309145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-env-overrides\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.309145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-modprobe-d\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.309145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309092    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysctl-d\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.309145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.309145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-ovnkube-script-lib\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-cni-netd\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb2cj\" (UniqueName: \"kubernetes.io/projected/de1c4cc2-9902-431e-828b-f26f2f680113-kube-api-access-hb2cj\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-etc-kubernetes\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkrbb\" (UniqueName: \"kubernetes.io/projected/4f10a87a-64a9-42b9-bb26-4e33daf1f562-kube-api-access-hkrbb\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-os-release\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-cni-multus\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bllj\" (UniqueName: \"kubernetes.io/projected/d945a800-d054-4e6a-9d7c-d902407d676d-kube-api-access-5bllj\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysctl-d\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-ovn\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-cni-bin\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.309338 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crnkz\" (UniqueName: \"kubernetes.io/projected/62a896c1-c68a-473e-abda-f4c1486c4281-kube-api-access-crnkz\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309351    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-kubernetes\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-cnibin\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-var-lib-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-system-cni-dir\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf35354-ac57-4479-906c-20c8a2243e10-dbus\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309589    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-cni-binary-copy\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-system-cni-dir\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-cnibin\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309643    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-cni-bin\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-env-overrides\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c48bca2c-b24e-4ed6-8b84-c2774186e491-os-release\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-slash\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-kubernetes\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48028eed-5735-4146-a227-19f187a5af5f-tmp-dir\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.310279 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-var-lib-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-modprobe-d\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-slash\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b849\" (UniqueName: \"kubernetes.io/projected/c48bca2c-b24e-4ed6-8b84-c2774186e491-kube-api-access-9b849\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309803    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-ovn\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-cni-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d945a800-d054-4e6a-9d7c-d902407d676d-multus-daemon-config\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.309997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-systemd\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48028eed-5735-4146-a227-19f187a5af5f-tmp-dir\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62a896c1-c68a-473e-abda-f4c1486c4281-ovn-node-metrics-cert\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c48bca2c-b24e-4ed6-8b84-c2774186e491-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-systemd\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310087    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-run\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-socket-dir-parent\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69196957-9b66-415e-a184-bcb4109b987b-iptables-alerter-script\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-etc-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311124 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysconfig\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310327    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de1c4cc2-9902-431e-828b-f26f2f680113-serviceca\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-k8s-cni-cncf-io\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-device-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24rhv\" (UniqueName: \"kubernetes.io/projected/06f3296a-efb8-49c2-8bc6-34602a69c91f-kube-api-access-24rhv\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-node-log\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310393    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-netns\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf35354-ac57-4479-906c-20c8a2243e10-kubelet-config\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwlt6\" (UniqueName: \"kubernetes.io/projected/69196957-9b66-415e-a184-bcb4109b987b-kube-api-access-vwlt6\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-systemd-units\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-ovnkube-config\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-cni-bin\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-registration-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-var-lib-kubelet\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-kubelet\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.311883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysctl-conf\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-sys\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-lib-modules\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-tuned\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310675    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgbcf\" (UniqueName: \"kubernetes.io/projected/4cf4fcd6-e1bb-460c-a875-713dd6476858-kube-api-access-pgbcf\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48028eed-5735-4146-a227-19f187a5af5f-hosts-file\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-host\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cf4fcd6-e1bb-460c-a875-713dd6476858-tmp\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-cnibin\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69196957-9b66-415e-a184-bcb4109b987b-iptables-alerter-script\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310228    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-run\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310926    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-run-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysctl-conf\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-host-kubelet\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.310956    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-sys\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-lib-modules\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/48028eed-5735-4146-a227-19f187a5af5f-hosts-file\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311040    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-var-lib-kubelet\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.312658 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311046    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-etc-openvswitch\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.313226 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-systemd-units\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.313226 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311079    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-sysconfig\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.313226 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311080    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/62a896c1-c68a-473e-abda-f4c1486c4281-node-log\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.313226 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311394    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4cf4fcd6-e1bb-460c-a875-713dd6476858-host\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.313226 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.311431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/62a896c1-c68a-473e-abda-f4c1486c4281-ovnkube-config\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.314163 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.314144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4cf4fcd6-e1bb-460c-a875-713dd6476858-etc-tuned\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.314266 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.314248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4cf4fcd6-e1bb-460c-a875-713dd6476858-tmp\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.314495 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.314480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/62a896c1-c68a-473e-abda-f4c1486c4281-ovn-node-metrics-cert\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.322887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.322861    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwmzh"
Aug 04 15:06:28.335372 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.335350    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:28.335372 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.335376    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:28.335512 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.335387    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:28.335512 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.335452    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:06:28.835435738 +0000 UTC m=+3.050448516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:28.335914 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.335891    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwmzh"
Aug 04 15:06:28.340673 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.340650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hghng\" (UniqueName: \"kubernetes.io/projected/48028eed-5735-4146-a227-19f187a5af5f-kube-api-access-hghng\") pod \"node-resolver-9kf6d\" (UID: \"48028eed-5735-4146-a227-19f187a5af5f\") " pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.340915 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.340896    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgbcf\" (UniqueName: \"kubernetes.io/projected/4cf4fcd6-e1bb-460c-a875-713dd6476858-kube-api-access-pgbcf\") pod \"tuned-jz2dv\" (UID: \"4cf4fcd6-e1bb-460c-a875-713dd6476858\") " pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.342292 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.342262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crnkz\" (UniqueName: \"kubernetes.io/projected/62a896c1-c68a-473e-abda-f4c1486c4281-kube-api-access-crnkz\") pod \"ovnkube-node-flfvl\" (UID: \"62a896c1-c68a-473e-abda-f4c1486c4281\") " pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.342618 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.342601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwlt6\" (UniqueName: \"kubernetes.io/projected/69196957-9b66-415e-a184-bcb4109b987b-kube-api-access-vwlt6\") pod \"iptables-alerter-nq4zr\" (UID: \"69196957-9b66-415e-a184-bcb4109b987b\") " pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.343037 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.343014    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b849\" (UniqueName: \"kubernetes.io/projected/c48bca2c-b24e-4ed6-8b84-c2774186e491-kube-api-access-9b849\") pod \"multus-additional-cni-plugins-ngrnw\" (UID: \"c48bca2c-b24e-4ed6-8b84-c2774186e491\") " pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.411769 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-socket-dir-parent\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.411769 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de1c4cc2-9902-431e-828b-f26f2f680113-serviceca\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411811    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-k8s-cni-cncf-io\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411836    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-device-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24rhv\" (UniqueName: \"kubernetes.io/projected/06f3296a-efb8-49c2-8bc6-34602a69c91f-kube-api-access-24rhv\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-socket-dir-parent\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-k8s-cni-cncf-io\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-netns\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411945    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-device-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf35354-ac57-4479-906c-20c8a2243e10-kubelet-config\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.411995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.411991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-cni-bin\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6cf35354-ac57-4479-906c-20c8a2243e10-kubelet-config\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-registration-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-netns\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-cnibin\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-cni-bin\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d945a800-d054-4e6a-9d7c-d902407d676d-cni-binary-copy\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-hostroot\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de1c4cc2-9902-431e-828b-f26f2f680113-host\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-registration-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-os-release\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-sys-fs\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-socket-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412254    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/de1c4cc2-9902-431e-828b-f26f2f680113-serviceca\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.412275    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/de1c4cc2-9902-431e-828b-f26f2f680113-host\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.412414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-os-release\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412377    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-cnibin\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.412334    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:06:28.91231611 +0000 UTC m=+3.127328903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-socket-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.412443    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-hostroot\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.412489    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:28.91247665 +0000 UTC m=+3.127489426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412483    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-sys-fs\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-multus-certs\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/accd62b8-2240-4a4d-a798-d0b60190dd70-agent-certs\") pod \"konnectivity-agent-xq2ng\" (UID: \"accd62b8-2240-4a4d-a798-d0b60190dd70\") " pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412578    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/accd62b8-2240-4a4d-a798-d0b60190dd70-konnectivity-ca\") pod \"konnectivity-agent-xq2ng\" (UID: \"accd62b8-2240-4a4d-a798-d0b60190dd70\") " pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-etc-selinux\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-run-multus-certs\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-system-cni-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d945a800-d054-4e6a-9d7c-d902407d676d-cni-binary-copy\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412650    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-kubelet\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-conf-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb2cj\" (UniqueName: \"kubernetes.io/projected/de1c4cc2-9902-431e-828b-f26f2f680113-kube-api-access-hb2cj\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-etc-kubernetes\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkrbb\" (UniqueName: \"kubernetes.io/projected/4f10a87a-64a9-42b9-bb26-4e33daf1f562-kube-api-access-hkrbb\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-etc-selinux\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412752    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-cni-multus\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412771    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-conf-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bllj\" (UniqueName: \"kubernetes.io/projected/d945a800-d054-4e6a-9d7c-d902407d676d-kube-api-access-5bllj\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf35354-ac57-4479-906c-20c8a2243e10-dbus\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-cni-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d945a800-d054-4e6a-9d7c-d902407d676d-multus-daemon-config\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412874    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.412876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-kubelet\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413031    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-host-var-lib-cni-multus\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413087    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-system-cni-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f10a87a-64a9-42b9-bb26-4e33daf1f562-kubelet-dir\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/accd62b8-2240-4a4d-a798-d0b60190dd70-konnectivity-ca\") pod \"konnectivity-agent-xq2ng\" (UID: \"accd62b8-2240-4a4d-a798-d0b60190dd70\") " pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413181    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-etc-kubernetes\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d945a800-d054-4e6a-9d7c-d902407d676d-multus-cni-dir\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.413835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6cf35354-ac57-4479-906c-20c8a2243e10-dbus\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.414391 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.413495    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d945a800-d054-4e6a-9d7c-d902407d676d-multus-daemon-config\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.415454 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.415434    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/accd62b8-2240-4a4d-a798-d0b60190dd70-agent-certs\") pod \"konnectivity-agent-xq2ng\" (UID: \"accd62b8-2240-4a4d-a798-d0b60190dd70\") " pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.423699 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.423635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24rhv\" (UniqueName: \"kubernetes.io/projected/06f3296a-efb8-49c2-8bc6-34602a69c91f-kube-api-access-24rhv\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.441891 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.441864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb2cj\" (UniqueName: \"kubernetes.io/projected/de1c4cc2-9902-431e-828b-f26f2f680113-kube-api-access-hb2cj\") pod \"node-ca-vn8zq\" (UID: \"de1c4cc2-9902-431e-828b-f26f2f680113\") " pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.468027 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.467996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkrbb\" (UniqueName: \"kubernetes.io/projected/4f10a87a-64a9-42b9-bb26-4e33daf1f562-kube-api-access-hkrbb\") pod \"aws-ebs-csi-driver-node-knwf7\" (UID: \"4f10a87a-64a9-42b9-bb26-4e33daf1f562\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.470038 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.470019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bllj\" (UniqueName: \"kubernetes.io/projected/d945a800-d054-4e6a-9d7c-d902407d676d-kube-api-access-5bllj\") pod \"multus-wq5s8\" (UID: \"d945a800-d054-4e6a-9d7c-d902407d676d\") " pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.493928 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.493892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:28.502131 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.502103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jz2dv"
Aug 04 15:06:28.511087 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.511057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9kf6d"
Aug 04 15:06:28.519867 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.519843    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ngrnw"
Aug 04 15:06:28.529599 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.529573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nq4zr"
Aug 04 15:06:28.536460 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.536435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wq5s8"
Aug 04 15:06:28.543358 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.543318    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:28.549457 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.549437    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7"
Aug 04 15:06:28.554386 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.554359    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vn8zq"
Aug 04 15:06:28.881566 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.881466    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:28.916515 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.916481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:28.916515 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.916518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:28.916740 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:28.916613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:28.916740 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916655    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:28.916740 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916707    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:29.916694172 +0000 UTC m=+4.131706946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:28.916880 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916742    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:28.916880 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916761    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:28.916880 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916774    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:28.916880 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916795    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:28.916880 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916838    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:06:29.916822577 +0000 UTC m=+4.131835369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:28.917067 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:28.916895    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:06:29.916881434 +0000 UTC m=+4.131894218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:28.987504 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.987461    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccd62b8_2240_4a4d_a798_d0b60190dd70.slice/crio-111d280f414ea9ba466075822658b0cd3d94a8bcc17aa86704c563339b621dd8 WatchSource:0}: Error finding container 111d280f414ea9ba466075822658b0cd3d94a8bcc17aa86704c563339b621dd8: Status 404 returned error can't find the container with id 111d280f414ea9ba466075822658b0cd3d94a8bcc17aa86704c563339b621dd8
Aug 04 15:06:28.988226 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.988201    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48028eed_5735_4146_a227_19f187a5af5f.slice/crio-f2b195877b0ff27cb0c30070429a516d6db222e2a1f62bfa2bb6b1f0ec28c8fd WatchSource:0}: Error finding container f2b195877b0ff27cb0c30070429a516d6db222e2a1f62bfa2bb6b1f0ec28c8fd: Status 404 returned error can't find the container with id f2b195877b0ff27cb0c30070429a516d6db222e2a1f62bfa2bb6b1f0ec28c8fd
Aug 04 15:06:28.991968 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.991202    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd945a800_d054_4e6a_9d7c_d902407d676d.slice/crio-64f32d62fa6fb41b980fe9e657740c6a28cbcad9d47b153d8469f9663607926b WatchSource:0}: Error finding container 64f32d62fa6fb41b980fe9e657740c6a28cbcad9d47b153d8469f9663607926b: Status 404 returned error can't find the container with id 64f32d62fa6fb41b980fe9e657740c6a28cbcad9d47b153d8469f9663607926b
Aug 04 15:06:28.993484 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.993465    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f10a87a_64a9_42b9_bb26_4e33daf1f562.slice/crio-eff9eab7fb54746d2d5f38c7d0ce5f4f862223829faf222b3c6c153988c0a9d8 WatchSource:0}: Error finding container eff9eab7fb54746d2d5f38c7d0ce5f4f862223829faf222b3c6c153988c0a9d8: Status 404 returned error can't find the container with id eff9eab7fb54746d2d5f38c7d0ce5f4f862223829faf222b3c6c153988c0a9d8
Aug 04 15:06:28.994919 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.994886    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48bca2c_b24e_4ed6_8b84_c2774186e491.slice/crio-2450e20219621995479e362f4dc006c1c22f036273adf05a828e232f29fc95a5 WatchSource:0}: Error finding container 2450e20219621995479e362f4dc006c1c22f036273adf05a828e232f29fc95a5: Status 404 returned error can't find the container with id 2450e20219621995479e362f4dc006c1c22f036273adf05a828e232f29fc95a5
Aug 04 15:06:28.996483 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.996366    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf4fcd6_e1bb_460c_a875_713dd6476858.slice/crio-ce1d374d14978b4344b3dd2e132942a8c3835b98c49b29e2547bd4b9a89be3bb WatchSource:0}: Error finding container ce1d374d14978b4344b3dd2e132942a8c3835b98c49b29e2547bd4b9a89be3bb: Status 404 returned error can't find the container with id ce1d374d14978b4344b3dd2e132942a8c3835b98c49b29e2547bd4b9a89be3bb
Aug 04 15:06:28.997388 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:28.997368    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69196957_9b66_415e_a184_bcb4109b987b.slice/crio-e300eb3972853446e513fb265fbbd17f52e88f9eeac4e02d2a697dcc82f77f2f WatchSource:0}: Error finding container e300eb3972853446e513fb265fbbd17f52e88f9eeac4e02d2a697dcc82f77f2f: Status 404 returned error can't find the container with id e300eb3972853446e513fb265fbbd17f52e88f9eeac4e02d2a697dcc82f77f2f
Aug 04 15:06:29.020519 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:29.020498    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde1c4cc2_9902_431e_828b_f26f2f680113.slice/crio-bdcd3c9bcf697ae1a984b7207ab461f7e6e9d27e876335ada18c1bc79f8ba34b WatchSource:0}: Error finding container bdcd3c9bcf697ae1a984b7207ab461f7e6e9d27e876335ada18c1bc79f8ba34b: Status 404 returned error can't find the container with id bdcd3c9bcf697ae1a984b7207ab461f7e6e9d27e876335ada18c1bc79f8ba34b
Aug 04 15:06:29.022054 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:06:29.022034    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62a896c1_c68a_473e_abda_f4c1486c4281.slice/crio-c17e16967e30fa6e85d37654b9e04639eb07e8ec6ba98b078e09d11ba0dfd09f WatchSource:0}: Error finding container c17e16967e30fa6e85d37654b9e04639eb07e8ec6ba98b078e09d11ba0dfd09f: Status 404 returned error can't find the container with id c17e16967e30fa6e85d37654b9e04639eb07e8ec6ba98b078e09d11ba0dfd09f
Aug 04 15:06:29.307291 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.307248    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jz2dv" event={"ID":"4cf4fcd6-e1bb-460c-a875-713dd6476858","Type":"ContainerStarted","Data":"ce1d374d14978b4344b3dd2e132942a8c3835b98c49b29e2547bd4b9a89be3bb"}
Aug 04 15:06:29.308564 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.308512    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerStarted","Data":"2450e20219621995479e362f4dc006c1c22f036273adf05a828e232f29fc95a5"}
Aug 04 15:06:29.309636 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.309609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7" event={"ID":"4f10a87a-64a9-42b9-bb26-4e33daf1f562","Type":"ContainerStarted","Data":"eff9eab7fb54746d2d5f38c7d0ce5f4f862223829faf222b3c6c153988c0a9d8"}
Aug 04 15:06:29.310750 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.310727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wq5s8" event={"ID":"d945a800-d054-4e6a-9d7c-d902407d676d","Type":"ContainerStarted","Data":"64f32d62fa6fb41b980fe9e657740c6a28cbcad9d47b153d8469f9663607926b"}
Aug 04 15:06:29.311925 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.311901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9kf6d" event={"ID":"48028eed-5735-4146-a227-19f187a5af5f","Type":"ContainerStarted","Data":"f2b195877b0ff27cb0c30070429a516d6db222e2a1f62bfa2bb6b1f0ec28c8fd"}
Aug 04 15:06:29.313839 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.313815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" event={"ID":"3768d099968536462897c691c261bff2","Type":"ContainerStarted","Data":"91ada16944ababa738ef4b51e733f44ae484366db0a7dc421005980105bcfdc2"}
Aug 04 15:06:29.315389 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.315368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"c17e16967e30fa6e85d37654b9e04639eb07e8ec6ba98b078e09d11ba0dfd09f"}
Aug 04 15:06:29.316574 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.316551    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vn8zq" event={"ID":"de1c4cc2-9902-431e-828b-f26f2f680113","Type":"ContainerStarted","Data":"bdcd3c9bcf697ae1a984b7207ab461f7e6e9d27e876335ada18c1bc79f8ba34b"}
Aug 04 15:06:29.317737 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.317713    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nq4zr" event={"ID":"69196957-9b66-415e-a184-bcb4109b987b","Type":"ContainerStarted","Data":"e300eb3972853446e513fb265fbbd17f52e88f9eeac4e02d2a697dcc82f77f2f"}
Aug 04 15:06:29.318884 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.318862    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xq2ng" event={"ID":"accd62b8-2240-4a4d-a798-d0b60190dd70","Type":"ContainerStarted","Data":"111d280f414ea9ba466075822658b0cd3d94a8bcc17aa86704c563339b621dd8"}
Aug 04 15:06:29.339839 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.339807    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:01:28 +0000 UTC" deadline="2028-03-07 04:42:01.945023214 +0000 UTC"
Aug 04 15:06:29.339839 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.339835    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13933h35m32.60519255s"
Aug 04 15:06:29.925467 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.925217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:29.925647 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.925521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:29.925647 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:29.925570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:29.925790 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.925708    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:29.925790 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.925769    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:31.925751109 +0000 UTC m=+6.140763887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:29.926195 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.926175    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:29.926291 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.926201    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:29.926291 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.926215    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:29.926291 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.926259    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:06:31.926242653 +0000 UTC m=+6.141255430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:29.926468 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.926327    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:29.926468 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:29.926367    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:06:31.926347816 +0000 UTC m=+6.141360592 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:30.299170 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:30.299139    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:30.299372 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:30.299277    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:30.299704 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:30.299683    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:30.299826 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:30.299780    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:30.299879 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:30.299837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:30.299938 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:30.299909    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:30.340387 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:30.340338    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:01:28 +0000 UTC" deadline="2028-02-13 12:14:08.985891185 +0000 UTC"
Aug 04 15:06:30.340387 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:30.340373    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13389h7m38.645522481s"
Aug 04 15:06:31.941924 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:31.941891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:31.941924 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:31.941930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942062    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:31.942065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942069    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942124    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:35.942098381 +0000 UTC m=+10.157111157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942182    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:06:35.942168278 +0000 UTC m=+10.157181053 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942196    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942216    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942229    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:31.942632 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:31.942287    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:06:35.942266363 +0000 UTC m=+10.157279139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:32.299862 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:32.299019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:32.299862 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:32.299175    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:32.299862 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:32.299584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:32.299862 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:32.299676    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:32.299862 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:32.299739    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:32.299862 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:32.299803    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:32.339585 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:32.339545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"bab3e87aa201c92a5c8e9edbf625e72a","Type":"ContainerStarted","Data":"7c98685622dea548f11d1fee7c4ede3ca707bc055db5aa01ea715c5e5a454a7a"}
Aug 04 15:06:32.364929 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:32.364854    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-247.ec2.internal" podStartSLOduration=5.364832001 podStartE2EDuration="5.364832001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:29.335714988 +0000 UTC m=+3.550727786" watchObservedRunningTime="2026-08-04 15:06:32.364832001 +0000 UTC m=+6.579844798"
Aug 04 15:06:34.299435 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:34.298674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:34.299435 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:34.298805    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:34.299435 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:34.299157    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:34.299435 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:34.299249    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:34.299435 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:34.299303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:34.299435 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:34.299381    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:35.977608 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:35.977566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:35.977651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:35.977680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.977797    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.977860    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:43.977840948 +0000 UTC m=+18.192853728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.977942    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.977956    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.977968    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.978004    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:06:43.977991764 +0000 UTC m=+18.193004543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:35.978066 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.978074    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:35.978597 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:35.978103    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:06:43.97809276 +0000 UTC m=+18.193105535 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:36.298571 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:36.297682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:36.298571 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:36.297794    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:36.298571 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:36.298190    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:36.298571 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:36.298324    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:36.298571 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:36.298377    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:36.298571 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:36.298452    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:38.296888 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:38.296852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:38.297341 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:38.296991    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:38.297458 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:38.297431    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:38.297599 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:38.297549    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:38.297683 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:38.297661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:38.297796 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:38.297769    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:38.355887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:38.355833    2581 generic.go:356] "Generic (PLEG): container finished" podID="bab3e87aa201c92a5c8e9edbf625e72a" containerID="7c98685622dea548f11d1fee7c4ede3ca707bc055db5aa01ea715c5e5a454a7a" exitCode=0
Aug 04 15:06:38.355887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:38.355882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"bab3e87aa201c92a5c8e9edbf625e72a","Type":"ContainerDied","Data":"7c98685622dea548f11d1fee7c4ede3ca707bc055db5aa01ea715c5e5a454a7a"}
Aug 04 15:06:40.296695 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:40.296666    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:40.297091 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:40.296666    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:40.297091 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:40.296771    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:40.297091 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:40.296673    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:40.297091 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:40.296836    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:40.297091 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:40.296937    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:42.297257 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:42.297216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:42.297730 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:42.297228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:42.297730 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:42.297345    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:42.297730 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:42.297363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:42.297730 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:42.297447    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:42.297730 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:42.297509    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:44.047006 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:44.046962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:44.047006 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:44.047007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:44.047036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047123    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047143    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047158    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047166    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047185    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:00.047169264 +0000 UTC m=+34.262182037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047203    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:07:00.047192417 +0000 UTC m=+34.262205191 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047123    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:44.047471 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.047247    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:07:00.047230749 +0000 UTC m=+34.262243530 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:44.296816 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:44.296778    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:44.297001 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:44.296832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:44.297001 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:44.296832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:44.297001 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.296911    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:44.297206 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.297021    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:44.297206 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:44.297129    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:46.297834 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:46.297789    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:46.298267 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:46.297880    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:46.298267 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:46.297892    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:46.298267 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:46.298005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:46.298267 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:46.298039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:46.298267 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:46.298163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:48.297182 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.296548    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:48.297182 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.296862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:48.297182 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:48.296865    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:48.297182 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:48.296943    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:48.297182 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.296983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:48.297182 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:48.297054    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:48.378236 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.378073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xq2ng" event={"ID":"accd62b8-2240-4a4d-a798-d0b60190dd70","Type":"ContainerStarted","Data":"200f94b8992a89d85c2930b8dd163ce15b0d060862adbbef8394e0cae09b0777"}
Aug 04 15:06:48.381123 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.381047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" event={"ID":"bab3e87aa201c92a5c8e9edbf625e72a","Type":"ContainerStarted","Data":"16260bd59e94f67ec202d1bc3f1e08d965b9a7b5307fa75017337fe7289c8007"}
Aug 04 15:06:48.383425 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.383042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jz2dv" event={"ID":"4cf4fcd6-e1bb-460c-a875-713dd6476858","Type":"ContainerStarted","Data":"0ce5364f2248c8fd9331416ae6ac8e811c140e7a4863c8b506d0533a64168e50"}
Aug 04 15:06:48.393080 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.388252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerStarted","Data":"00d0b324678a2233998f2bd711123ec7afa1899dbaaa073fed1190d0571dab3f"}
Aug 04 15:06:48.393080 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.391503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7" event={"ID":"4f10a87a-64a9-42b9-bb26-4e33daf1f562","Type":"ContainerStarted","Data":"aa769a34f34c7a6f8d71048d4bae00da3210cc8fe95915900b26d2292a5bb3d8"}
Aug 04 15:06:48.393395 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.393366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wq5s8" event={"ID":"d945a800-d054-4e6a-9d7c-d902407d676d","Type":"ContainerStarted","Data":"ab5e9d9c41e1212dbf6a604ff09925a0bddc47851299c051d7edeee6ec968e05"}
Aug 04 15:06:48.395452 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.395419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9kf6d" event={"ID":"48028eed-5735-4146-a227-19f187a5af5f","Type":"ContainerStarted","Data":"b39b765cbe9d2277a7deb6ceb6d3465d7d52ce4d719f7cd74f9ce854c2697c61"}
Aug 04 15:06:48.396854 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.396823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"33c6ba636bbfd0cd36a3392b6fe0f4a46d930b03ab3ce508b771d9b01adeb923"}
Aug 04 15:06:48.399757 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.399549    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vn8zq" event={"ID":"de1c4cc2-9902-431e-828b-f26f2f680113","Type":"ContainerStarted","Data":"b321a399996198d220628992cd8e96cf7ba61c095bdd43fa88c2b3e59f72225a"}
Aug 04 15:06:48.421614 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.421567    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xq2ng" podStartSLOduration=3.30368587 podStartE2EDuration="22.42154913s" totalImagesPullingTime="19.11786326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:48.42078588 +0000 UTC m=+22.635798676" watchObservedRunningTime="2026-08-04 15:06:48.42154913 +0000 UTC m=+22.636561921"
Aug 04 15:06:48.562605 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.562555    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jz2dv" podStartSLOduration=3.48191235 podStartE2EDuration="22.562519602s" totalImagesPullingTime="19.080607252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:48.482511354 +0000 UTC m=+22.697524149" watchObservedRunningTime="2026-08-04 15:06:48.562519602 +0000 UTC m=+22.777532398"
Aug 04 15:06:48.562871 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.562848    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9kf6d" podStartSLOduration=3.445182759 podStartE2EDuration="22.562842215s" totalImagesPullingTime="19.117659456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:48.56274493 +0000 UTC m=+22.777757728" watchObservedRunningTime="2026-08-04 15:06:48.562842215 +0000 UTC m=+22.777855010"
Aug 04 15:06:48.858186 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.858097    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-247.ec2.internal" podStartSLOduration=21.858081478 podStartE2EDuration="21.858081478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:48.76111225 +0000 UTC m=+22.976125044" watchObservedRunningTime="2026-08-04 15:06:48.858081478 +0000 UTC m=+23.073094273"
Aug 04 15:06:48.858186 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.858166    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wq5s8" podStartSLOduration=3.697918337 podStartE2EDuration="22.85815986s" totalImagesPullingTime="19.160241523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:48.857807552 +0000 UTC m=+23.072820348" watchObservedRunningTime="2026-08-04 15:06:48.85815986 +0000 UTC m=+23.073172655"
Aug 04 15:06:48.915492 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:48.915441    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vn8zq" podStartSLOduration=3.840538423 podStartE2EDuration="22.91542527s" totalImagesPullingTime="19.074886847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:48.915256338 +0000 UTC m=+23.130269132" watchObservedRunningTime="2026-08-04 15:06:48.91542527 +0000 UTC m=+23.130438065"
Aug 04 15:06:49.014548 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.014502    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:49.015136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.015117    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:49.406120 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.406075    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"b0a1c296a63d721af31fb025b9e12f6122610b63758c655f9ab27e07d7adc969"}
Aug 04 15:06:49.407049 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.406232    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"a95567cb2f542c3007cacfa4205657957484fcd7d4f319fcad3a16d609515c0c"}
Aug 04 15:06:49.407049 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.406292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"db6dd90f550745db3618bb9d8487db7ff5dfd7a950c0262ee796295c3ae057c4"}
Aug 04 15:06:49.407049 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.406327    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"f44ebbb1d2d1707f9fd6d47bc3bfa4362961a855dca05e431599a5dcf0a1fcac"}
Aug 04 15:06:49.407049 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.406370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"12f8301f5b9d87cb0fbeba08fad6a6afde09c7938f756ac7dc367cac201cd8ef"}
Aug 04 15:06:49.407792 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.407763    2581 generic.go:356] "Generic (PLEG): container finished" podID="c48bca2c-b24e-4ed6-8b84-c2774186e491" containerID="00d0b324678a2233998f2bd711123ec7afa1899dbaaa073fed1190d0571dab3f" exitCode=0
Aug 04 15:06:49.407925 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:49.407891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerDied","Data":"00d0b324678a2233998f2bd711123ec7afa1899dbaaa073fed1190d0571dab3f"}
Aug 04 15:06:50.054029 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.053983    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 15:06:50.261877 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.261732    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T15:06:50.054007206Z","UUID":"ea25d467-2662-495a-a57b-2dcaa30c62ba","Handler":null,"Name":"","Endpoint":""}
Aug 04 15:06:50.264013 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.263990    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 15:06:50.264158 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.264034    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 15:06:50.296499 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.296468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:50.296695 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.296467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:50.296695 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.296477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:50.296695 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:50.296665    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:50.296855 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:50.296779    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:50.296896 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:50.296879    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:50.411901 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.411865    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7" event={"ID":"4f10a87a-64a9-42b9-bb26-4e33daf1f562","Type":"ContainerStarted","Data":"771180e2d02585997994b154c04f61d924f3b67fef8f73f923a503cd9a5bd53b"}
Aug 04 15:06:50.413574 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.413456    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nq4zr" event={"ID":"69196957-9b66-415e-a184-bcb4109b987b","Type":"ContainerStarted","Data":"b819cbbe9bda4c4e2bbabd814a0c8e1c0c7cddac73171125e5486093e16b0fb0"}
Aug 04 15:06:50.413574 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.413520    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Aug 04 15:06:50.444373 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.444296    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nq4zr" podStartSLOduration=5.364052407 podStartE2EDuration="24.444274893s" totalImagesPullingTime="19.080222486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:50.444179888 +0000 UTC m=+24.659192687" watchObservedRunningTime="2026-08-04 15:06:50.444274893 +0000 UTC m=+24.659287690"
Aug 04 15:06:50.575682 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.575594    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:50.576218 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:50.576196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xq2ng"
Aug 04 15:06:51.427475 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:51.427432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"97b417376c75442502ebb1ed847cb06c88f8df78a275df545f3b5333f8d7321c"}
Aug 04 15:06:52.296775 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:52.296593    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:52.297020 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:52.296594    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:52.297020 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:52.296598    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:52.297020 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:52.296937    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:52.297020 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:52.296841    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:52.297020 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:52.297001    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:52.432477 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:52.432436    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7" event={"ID":"4f10a87a-64a9-42b9-bb26-4e33daf1f562","Type":"ContainerStarted","Data":"f9701b9eafbdf8c4cac3b6e1fe9c1ac9af95f01e817abc664e8a9db59e611172"}
Aug 04 15:06:52.457640 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:52.457593    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-knwf7" podStartSLOduration=4.232912039 podStartE2EDuration="26.45757356s" totalImagesPullingTime="22.224661521s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:52.456886402 +0000 UTC m=+26.671899197" watchObservedRunningTime="2026-08-04 15:06:52.45757356 +0000 UTC m=+26.672586355"
Aug 04 15:06:54.296722 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.296448    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:54.296722 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.296448    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:54.297415 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:54.296765    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:54.297415 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.296454    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:54.297415 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:54.296824    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:54.297415 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:54.296896    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:54.439805 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.439767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" event={"ID":"62a896c1-c68a-473e-abda-f4c1486c4281","Type":"ContainerStarted","Data":"5a2984f7496863e704d93ed310c5da510caa311f1d13a8a9cd785994d98a5a25"}
Aug 04 15:06:54.440267 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.440242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:54.440385 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.440315    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:54.440385 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.440363    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:54.456309 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.456283    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:54.460132 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.460110    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:06:54.482395 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:54.482337    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl" podStartSLOduration=9.334113202 podStartE2EDuration="28.482323674s" totalImagesPullingTime="19.148210472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:54.480195024 +0000 UTC m=+28.695207820" watchObservedRunningTime="2026-08-04 15:06:54.482323674 +0000 UTC m=+28.697336469"
Aug 04 15:06:55.444518 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:55.444477    2581 generic.go:356] "Generic (PLEG): container finished" podID="c48bca2c-b24e-4ed6-8b84-c2774186e491" containerID="2d4547c22726b94b6337799b0e1b378e8de169a718e792d61f8a056178003d2c" exitCode=0
Aug 04 15:06:55.446264 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:55.446229    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerDied","Data":"2d4547c22726b94b6337799b0e1b378e8de169a718e792d61f8a056178003d2c"}
Aug 04 15:06:56.297901 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.297862    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:56.298109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.297955    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:56.298109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.297994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:56.298109 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:56.298006    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:56.298109 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:56.298063    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:56.298307 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:56.298145    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:56.558618 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.558518    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtnjh"]
Aug 04 15:06:56.559142 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.558680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:56.559142 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:56.558780    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:56.566978 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.566692    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jh8wj"]
Aug 04 15:06:56.566978 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.566823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:56.566978 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:56.566937    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:56.567434 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.567397    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r9n6s"]
Aug 04 15:06:56.567584 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:56.567484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:56.567656 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:56.567605    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:57.454637 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:57.454451    2581 generic.go:356] "Generic (PLEG): container finished" podID="c48bca2c-b24e-4ed6-8b84-c2774186e491" containerID="2a1f13adbd2155cc1706ad402cf7d6a65789b11ae21dce07ff0d88d378213077" exitCode=0
Aug 04 15:06:57.454637 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:57.454546    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerDied","Data":"2a1f13adbd2155cc1706ad402cf7d6a65789b11ae21dce07ff0d88d378213077"}
Aug 04 15:06:58.296868 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:58.296838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:06:58.296868 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:58.296839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:06:58.297450 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:58.296839    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:06:58.297450 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:58.296978    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:06:58.297450 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:58.297016    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:06:58.297450 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:06:58.297118    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:06:59.460923 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:59.460889    2581 generic.go:356] "Generic (PLEG): container finished" podID="c48bca2c-b24e-4ed6-8b84-c2774186e491" containerID="dbcf31e0c5f6c3129df1268780a8effe0510be6a6f747842d282d4124686e26a" exitCode=0
Aug 04 15:06:59.461447 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:06:59.460938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerDied","Data":"dbcf31e0c5f6c3129df1268780a8effe0510be6a6f747842d282d4124686e26a"}
Aug 04 15:07:00.064482 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:00.064448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:00.064500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:00.064516    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064604    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064610    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064626    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064644    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064653    2581 projected.go:196] Error preparing data for projected volume kube-api-access-d8szw for pod openshift-network-diagnostics/network-check-target-r9n6s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064656    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret podName:6cf35354-ac57-4479-906c-20c8a2243e10 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:32.064642368 +0000 UTC m=+66.279655142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret") pod "global-pull-secret-syncer-mtnjh" (UID: "6cf35354-ac57-4479-906c-20c8a2243e10") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:07:00.064665 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064670    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs podName:06f3296a-efb8-49c2-8bc6-34602a69c91f nodeName:}" failed. No retries permitted until 2026-08-04 15:07:32.064663274 +0000 UTC m=+66.279676047 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs") pod "network-metrics-daemon-jh8wj" (UID: "06f3296a-efb8-49c2-8bc6-34602a69c91f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:07:00.064933 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.064693    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw podName:11f2ecf7-5630-4d3b-a680-7ccc0fa7254d nodeName:}" failed. No retries permitted until 2026-08-04 15:07:32.064676253 +0000 UTC m=+66.279689042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d8szw" (UniqueName: "kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw") pod "network-check-target-r9n6s" (UID: "11f2ecf7-5630-4d3b-a680-7ccc0fa7254d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:07:00.299903 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:00.299878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:07:00.300061 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:00.299911    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:07:00.300061 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:00.299878    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:00.300061 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.299976    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mtnjh" podUID="6cf35354-ac57-4479-906c-20c8a2243e10"
Aug 04 15:07:00.300061 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.300042    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r9n6s" podUID="11f2ecf7-5630-4d3b-a680-7ccc0fa7254d"
Aug 04 15:07:00.300219 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:00.300115    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jh8wj" podUID="06f3296a-efb8-49c2-8bc6-34602a69c91f"
Aug 04 15:07:01.125853 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.125784    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-247.ec2.internal" event="NodeReady"
Aug 04 15:07:01.126205 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.125894    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 15:07:01.174082 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.174050    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59ff746887-t8sd6"]
Aug 04 15:07:01.177847 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.177823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.181088 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.181059    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 04 15:07:01.181570 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.181349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 04 15:07:01.181708 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.181697    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j4zcx\""
Aug 04 15:07:01.181788 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.181767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 04 15:07:01.189406 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.189385    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 04 15:07:01.193662 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.193635    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j5kq2"]
Aug 04 15:07:01.197390 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.197318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59ff746887-t8sd6"]
Aug 04 15:07:01.197546 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.197468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.204663 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.203627    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kghgl\""
Aug 04 15:07:01.204663 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.203883    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 15:07:01.204663 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.204127    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 15:07:01.204663 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.204304    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7f2tt"]
Aug 04 15:07:01.208205 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.208181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.212958 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.212913    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 15:07:01.213162 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.213145    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 15:07:01.213428 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.213411    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 15:07:01.213826 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.213753    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j5kq2"]
Aug 04 15:07:01.213826 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.213768    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49dc4\""
Aug 04 15:07:01.225080 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.225052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7f2tt"]
Aug 04 15:07:01.273887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.273852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.273887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.273891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d46cb900-8fa0-45d4-a6a9-786659633dc7-tmp-dir\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.273938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-registry-certificates\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.273965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-trusted-ca\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.273979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-bound-sa-token\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.273995    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d46cb900-8fa0-45d4-a6a9-786659633dc7-config-volume\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.274017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6pbf\" (UniqueName: \"kubernetes.io/projected/d46cb900-8fa0-45d4-a6a9-786659633dc7-kube-api-access-w6pbf\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.274072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274136 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.274111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv25j\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-kube-api-access-sv25j\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.274178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-image-registry-private-configuration\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.274231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-installation-pull-secrets\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.274417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.274293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/688dca57-b71a-46c0-a1ad-b95613da205b-ca-trust-extracted\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.374829 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.374789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-installation-pull-secrets\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375014 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.374858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/688dca57-b71a-46c0-a1ad-b95613da205b-ca-trust-extracted\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375014 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.374887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.375014 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.374973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d46cb900-8fa0-45d4-a6a9-786659633dc7-tmp-dir\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.375175 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.375010    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 15:07:01.375175 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.375096    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls podName:d46cb900-8fa0-45d4-a6a9-786659633dc7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:01.875074549 +0000 UTC m=+36.090087331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls") pod "dns-default-j5kq2" (UID: "d46cb900-8fa0-45d4-a6a9-786659633dc7") : secret "dns-default-metrics-tls" not found
Aug 04 15:07:01.375175 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjdpw\" (UniqueName: \"kubernetes.io/projected/75f9a334-cb62-4030-9008-32c2c225241b-kube-api-access-pjdpw\") pod \"ingress-canary-7f2tt\" (UID: \"75f9a334-cb62-4030-9008-32c2c225241b\") " pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.375306 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75f9a334-cb62-4030-9008-32c2c225241b-cert\") pod \"ingress-canary-7f2tt\" (UID: \"75f9a334-cb62-4030-9008-32c2c225241b\") " pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.375306 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-registry-certificates\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375306 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-trusted-ca\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375306 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d46cb900-8fa0-45d4-a6a9-786659633dc7-tmp-dir\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.375484 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/688dca57-b71a-46c0-a1ad-b95613da205b-ca-trust-extracted\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375484 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-bound-sa-token\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375484 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d46cb900-8fa0-45d4-a6a9-786659633dc7-config-volume\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.375484 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6pbf\" (UniqueName: \"kubernetes.io/projected/d46cb900-8fa0-45d4-a6a9-786659633dc7-kube-api-access-w6pbf\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.375484 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375484 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv25j\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-kube-api-access-sv25j\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375764 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375487    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-image-registry-private-configuration\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375764 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.375636    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 15:07:01.375764 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.375650    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59ff746887-t8sd6: secret "image-registry-tls" not found
Aug 04 15:07:01.375764 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.375708    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls podName:688dca57-b71a-46c0-a1ad-b95613da205b nodeName:}" failed. No retries permitted until 2026-08-04 15:07:01.875690647 +0000 UTC m=+36.090703442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls") pod "image-registry-59ff746887-t8sd6" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b") : secret "image-registry-tls" not found
Aug 04 15:07:01.375990 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-registry-certificates\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.375990 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.375933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d46cb900-8fa0-45d4-a6a9-786659633dc7-config-volume\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.377105 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.377061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-trusted-ca\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.380636 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.380607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-image-registry-private-configuration\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.380746 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.380645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-installation-pull-secrets\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.394297 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.394262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6pbf\" (UniqueName: \"kubernetes.io/projected/d46cb900-8fa0-45d4-a6a9-786659633dc7-kube-api-access-w6pbf\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.394776 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.394756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv25j\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-kube-api-access-sv25j\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.395728 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.395700    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-bound-sa-token\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.476685 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.476651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjdpw\" (UniqueName: \"kubernetes.io/projected/75f9a334-cb62-4030-9008-32c2c225241b-kube-api-access-pjdpw\") pod \"ingress-canary-7f2tt\" (UID: \"75f9a334-cb62-4030-9008-32c2c225241b\") " pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.476685 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.476693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75f9a334-cb62-4030-9008-32c2c225241b-cert\") pod \"ingress-canary-7f2tt\" (UID: \"75f9a334-cb62-4030-9008-32c2c225241b\") " pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.479504 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.479461    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75f9a334-cb62-4030-9008-32c2c225241b-cert\") pod \"ingress-canary-7f2tt\" (UID: \"75f9a334-cb62-4030-9008-32c2c225241b\") " pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.486284 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.486261    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjdpw\" (UniqueName: \"kubernetes.io/projected/75f9a334-cb62-4030-9008-32c2c225241b-kube-api-access-pjdpw\") pod \"ingress-canary-7f2tt\" (UID: \"75f9a334-cb62-4030-9008-32c2c225241b\") " pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.521544 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.521496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7f2tt"
Aug 04 15:07:01.678843 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.678311    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7f2tt"]
Aug 04 15:07:01.681369 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:01.681336    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f9a334_cb62_4030_9008_32c2c225241b.slice/crio-43abe463ca4780e3d42eed278717793c07167f5ed4b355ddd0c7198c49d53296 WatchSource:0}: Error finding container 43abe463ca4780e3d42eed278717793c07167f5ed4b355ddd0c7198c49d53296: Status 404 returned error can't find the container with id 43abe463ca4780e3d42eed278717793c07167f5ed4b355ddd0c7198c49d53296
Aug 04 15:07:01.878912 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.878865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:01.879107 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:01.878941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:01.879107 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.879049    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 15:07:01.879107 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.879073    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 15:07:01.879107 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.879090    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59ff746887-t8sd6: secret "image-registry-tls" not found
Aug 04 15:07:01.879285 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.879130    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls podName:d46cb900-8fa0-45d4-a6a9-786659633dc7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:02.8791061 +0000 UTC m=+37.094118889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls") pod "dns-default-j5kq2" (UID: "d46cb900-8fa0-45d4-a6a9-786659633dc7") : secret "dns-default-metrics-tls" not found
Aug 04 15:07:01.879285 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:01.879156    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls podName:688dca57-b71a-46c0-a1ad-b95613da205b nodeName:}" failed. No retries permitted until 2026-08-04 15:07:02.879138204 +0000 UTC m=+37.094150982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls") pod "image-registry-59ff746887-t8sd6" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b") : secret "image-registry-tls" not found
Aug 04 15:07:02.297283 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.297248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:02.297890 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.297298    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:07:02.297890 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.297247    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:07:02.302679 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.302650    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8z69l\""
Aug 04 15:07:02.302832 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.302729    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 15:07:02.302832 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.302733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm4b6\""
Aug 04 15:07:02.302832 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.302805    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 15:07:02.302965 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.302650    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 15:07:02.303109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.303094    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 15:07:02.470586 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.470548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7f2tt" event={"ID":"75f9a334-cb62-4030-9008-32c2c225241b","Type":"ContainerStarted","Data":"43abe463ca4780e3d42eed278717793c07167f5ed4b355ddd0c7198c49d53296"}
Aug 04 15:07:02.887998 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.887967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:02.888195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:02.888048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:02.888195 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:02.888177    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 15:07:02.888288 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:02.888237    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls podName:d46cb900-8fa0-45d4-a6a9-786659633dc7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:04.888219946 +0000 UTC m=+39.103232736 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls") pod "dns-default-j5kq2" (UID: "d46cb900-8fa0-45d4-a6a9-786659633dc7") : secret "dns-default-metrics-tls" not found
Aug 04 15:07:02.888491 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:02.888464    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 15:07:02.888491 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:02.888489    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59ff746887-t8sd6: secret "image-registry-tls" not found
Aug 04 15:07:02.888644 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:02.888561    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls podName:688dca57-b71a-46c0-a1ad-b95613da205b nodeName:}" failed. No retries permitted until 2026-08-04 15:07:04.88852593 +0000 UTC m=+39.103538719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls") pod "image-registry-59ff746887-t8sd6" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b") : secret "image-registry-tls" not found
Aug 04 15:07:04.255741 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.255700    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wjj2j"]
Aug 04 15:07:04.259041 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.259008    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.262367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.262326    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 15:07:04.263064 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.262980    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 15:07:04.263064 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.263030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-46h4k\""
Aug 04 15:07:04.263771 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.263745    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 15:07:04.263947 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.263932    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 15:07:04.277330 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.277297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjj2j"]
Aug 04 15:07:04.399582 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.399542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlx2r\" (UniqueName: \"kubernetes.io/projected/1d1b8299-929e-4359-a39e-7633d034be0e-kube-api-access-mlx2r\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.399772 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.399641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1b8299-929e-4359-a39e-7633d034be0e-data-volume\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.399772 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.399674    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d1b8299-929e-4359-a39e-7633d034be0e-crio-socket\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.399772 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.399695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.399772 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.399718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.456345 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.456302    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"]
Aug 04 15:07:04.459626 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.459519    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"
Aug 04 15:07:04.463809 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.463782    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 04 15:07:04.463943 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.463820    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 04 15:07:04.464852 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.464833    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-f7pfs\""
Aug 04 15:07:04.480179 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.480150    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"]
Aug 04 15:07:04.500821 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.500791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlx2r\" (UniqueName: \"kubernetes.io/projected/1d1b8299-929e-4359-a39e-7633d034be0e-kube-api-access-mlx2r\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.501022 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.500858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1b8299-929e-4359-a39e-7633d034be0e-data-volume\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.501022 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.500893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d1b8299-929e-4359-a39e-7633d034be0e-crio-socket\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.501022 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.500908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.501022 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.500923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.501022 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.501005    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 15:07:04.501294 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.501039    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:04.501294 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.501085    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:05.001064833 +0000 UTC m=+39.216077629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : configmap "kube-rbac-proxy" not found
Aug 04 15:07:04.501294 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.501105    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:05.001095614 +0000 UTC m=+39.216108387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:04.501294 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.501168    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1d1b8299-929e-4359-a39e-7633d034be0e-crio-socket\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.501294 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.501284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1d1b8299-929e-4359-a39e-7633d034be0e-data-volume\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.513778 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.513716    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlx2r\" (UniqueName: \"kubernetes.io/projected/1d1b8299-929e-4359-a39e-7633d034be0e-kube-api-access-mlx2r\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:04.602195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.602152    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbxjw\" (UniqueName: \"kubernetes.io/projected/cbd9f097-5420-471c-8246-fe3ee1efa4ed-kube-api-access-cbxjw\") pod \"migrator-68bc745d87-n9b96\" (UID: \"cbd9f097-5420-471c-8246-fe3ee1efa4ed\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"
Aug 04 15:07:04.702868 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.702818    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbxjw\" (UniqueName: \"kubernetes.io/projected/cbd9f097-5420-471c-8246-fe3ee1efa4ed-kube-api-access-cbxjw\") pod \"migrator-68bc745d87-n9b96\" (UID: \"cbd9f097-5420-471c-8246-fe3ee1efa4ed\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"
Aug 04 15:07:04.714236 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.714204    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbxjw\" (UniqueName: \"kubernetes.io/projected/cbd9f097-5420-471c-8246-fe3ee1efa4ed-kube-api-access-cbxjw\") pod \"migrator-68bc745d87-n9b96\" (UID: \"cbd9f097-5420-471c-8246-fe3ee1efa4ed\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"
Aug 04 15:07:04.769659 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.769573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"
Aug 04 15:07:04.904573 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.904504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:04.904819 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:04.904640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:04.904819 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.904672    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 15:07:04.904819 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.904740    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 15:07:04.904819 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.904745    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls podName:d46cb900-8fa0-45d4-a6a9-786659633dc7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:08.904724525 +0000 UTC m=+43.119737301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls") pod "dns-default-j5kq2" (UID: "d46cb900-8fa0-45d4-a6a9-786659633dc7") : secret "dns-default-metrics-tls" not found
Aug 04 15:07:04.904819 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.904752    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59ff746887-t8sd6: secret "image-registry-tls" not found
Aug 04 15:07:04.904819 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:04.904784    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls podName:688dca57-b71a-46c0-a1ad-b95613da205b nodeName:}" failed. No retries permitted until 2026-08-04 15:07:08.904773458 +0000 UTC m=+43.119786248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls") pod "image-registry-59ff746887-t8sd6" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b") : secret "image-registry-tls" not found
Aug 04 15:07:05.005830 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.005800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:05.005830 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.005835    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:05.006026 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:05.005924    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 15:07:05.006026 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:05.005966    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:05.006026 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:05.006010    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:06.005988265 +0000 UTC m=+40.221001143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : configmap "kube-rbac-proxy" not found
Aug 04 15:07:05.006026 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:05.006025    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:06.006019255 +0000 UTC m=+40.221032029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:05.424903 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.424870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96"]
Aug 04 15:07:05.430834 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:05.430804    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd9f097_5420_471c_8246_fe3ee1efa4ed.slice/crio-8932ceffb89f6d93e8805ba7a776263c2382154b6697fc3649d2c9f941fef92d WatchSource:0}: Error finding container 8932ceffb89f6d93e8805ba7a776263c2382154b6697fc3649d2c9f941fef92d: Status 404 returned error can't find the container with id 8932ceffb89f6d93e8805ba7a776263c2382154b6697fc3649d2c9f941fef92d
Aug 04 15:07:05.480722 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.480688    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7f2tt" event={"ID":"75f9a334-cb62-4030-9008-32c2c225241b","Type":"ContainerStarted","Data":"30179eaae2e94d155b227c403a6fa4a9ae6db887540f1d8f78c68c7962a5416e"}
Aug 04 15:07:05.483506 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.483444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerStarted","Data":"8d67b6890af752291ba5035eb773be84233c56212fb04d08044eaccfa034a9c7"}
Aug 04 15:07:05.484750 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.484718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96" event={"ID":"cbd9f097-5420-471c-8246-fe3ee1efa4ed","Type":"ContainerStarted","Data":"8932ceffb89f6d93e8805ba7a776263c2382154b6697fc3649d2c9f941fef92d"}
Aug 04 15:07:05.508750 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.508654    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7f2tt" podStartSLOduration=0.924429492 podStartE2EDuration="4.508630037s" totalImagesPullingTime="3.584200545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:05.506305382 +0000 UTC m=+39.721318183" watchObservedRunningTime="2026-08-04 15:07:05.508630037 +0000 UTC m=+39.723642833"
Aug 04 15:07:05.603912 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:05.603883    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9kf6d_48028eed-5735-4146-a227-19f187a5af5f/dns-node-resolver/0.log"
Aug 04 15:07:06.014292 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:06.014236    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:06.014463 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:06.014300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:06.014463 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:06.014386    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 15:07:06.014463 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:06.014421    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:06.014607 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:06.014472    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:08.014457687 +0000 UTC m=+42.229470461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:06.014607 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:06.014484    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:08.014478329 +0000 UTC m=+42.229491103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : configmap "kube-rbac-proxy" not found
Aug 04 15:07:06.489715 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:06.489682    2581 generic.go:356] "Generic (PLEG): container finished" podID="c48bca2c-b24e-4ed6-8b84-c2774186e491" containerID="8d67b6890af752291ba5035eb773be84233c56212fb04d08044eaccfa034a9c7" exitCode=0
Aug 04 15:07:06.490076 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:06.489791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerDied","Data":"8d67b6890af752291ba5035eb773be84233c56212fb04d08044eaccfa034a9c7"}
Aug 04 15:07:06.808737 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:06.808663    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vn8zq_de1c4cc2-9902-431e-828b-f26f2f680113/node-ca/0.log"
Aug 04 15:07:07.407826 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.407797    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7f2tt_75f9a334-cb62-4030-9008-32c2c225241b/serve-healthcheck-canary/0.log"
Aug 04 15:07:07.442033 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.442007    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-mrvrs"]
Aug 04 15:07:07.459598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.459420    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-mrvrs"]
Aug 04 15:07:07.459598 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.459557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.463550 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.463417    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Aug 04 15:07:07.463722 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.463700    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Aug 04 15:07:07.464151 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.464134    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Aug 04 15:07:07.464825 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.464807    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Aug 04 15:07:07.465065 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.465051    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9x4rj\""
Aug 04 15:07:07.495158 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.495129    2581 generic.go:356] "Generic (PLEG): container finished" podID="c48bca2c-b24e-4ed6-8b84-c2774186e491" containerID="ba68006436bbd247ba5bc794be19c13144c0ceda971a73a87629d37ee72a0abd" exitCode=0
Aug 04 15:07:07.495636 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.495176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerDied","Data":"ba68006436bbd247ba5bc794be19c13144c0ceda971a73a87629d37ee72a0abd"}
Aug 04 15:07:07.626820 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.626795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-signing-cabundle\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.626958 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.626874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-signing-key\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.626958 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.626890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xhz6\" (UniqueName: \"kubernetes.io/projected/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-kube-api-access-8xhz6\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.727787 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.727756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-signing-cabundle\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.727893 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.727850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-signing-key\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.727893 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.727878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xhz6\" (UniqueName: \"kubernetes.io/projected/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-kube-api-access-8xhz6\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.728422 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.728397    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-signing-cabundle\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.730865 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.730840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-signing-key\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.738088 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.738066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xhz6\" (UniqueName: \"kubernetes.io/projected/2af4db0d-68d3-477f-ba5a-5f6d0309bb65-kube-api-access-8xhz6\") pod \"service-ca-98c88fbb5-mrvrs\" (UID: \"2af4db0d-68d3-477f-ba5a-5f6d0309bb65\") " pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.834462 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.834420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs"
Aug 04 15:07:07.984452 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:07.984422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-98c88fbb5-mrvrs"]
Aug 04 15:07:07.988189 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:07.988164    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af4db0d_68d3_477f_ba5a_5f6d0309bb65.slice/crio-d808ddb3f0603cddae558067565e32a8c1f73ea74f9cec1a3caaee0f000ef7eb WatchSource:0}: Error finding container d808ddb3f0603cddae558067565e32a8c1f73ea74f9cec1a3caaee0f000ef7eb: Status 404 returned error can't find the container with id d808ddb3f0603cddae558067565e32a8c1f73ea74f9cec1a3caaee0f000ef7eb
Aug 04 15:07:08.030335 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.030302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:08.030335 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.030336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:08.030547 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.030449    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 04 15:07:08.030547 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.030514    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:12.030499035 +0000 UTC m=+46.245511809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : configmap "kube-rbac-proxy" not found
Aug 04 15:07:08.030547 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.030522    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:08.030675 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.030586    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:12.030570354 +0000 UTC m=+46.245583134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:08.501093 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.501055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" event={"ID":"c48bca2c-b24e-4ed6-8b84-c2774186e491","Type":"ContainerStarted","Data":"c5e2005c0ca08ca76829317d7a9edfc467699c86210844d96cbb7159da83ab28"}
Aug 04 15:07:08.502972 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.502944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96" event={"ID":"cbd9f097-5420-471c-8246-fe3ee1efa4ed","Type":"ContainerStarted","Data":"9528cc7af7b858421c843722f2e66217efad5d45c985d5fb5abd463f59f77992"}
Aug 04 15:07:08.503107 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.502999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96" event={"ID":"cbd9f097-5420-471c-8246-fe3ee1efa4ed","Type":"ContainerStarted","Data":"0c44f3cf401b059b8ca160c27fdc31193bbc7bb873dbc2e1d4c24ce5a0da0883"}
Aug 04 15:07:08.503989 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.503968    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs" event={"ID":"2af4db0d-68d3-477f-ba5a-5f6d0309bb65","Type":"ContainerStarted","Data":"d808ddb3f0603cddae558067565e32a8c1f73ea74f9cec1a3caaee0f000ef7eb"}
Aug 04 15:07:08.534705 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.534652    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ngrnw" podStartSLOduration=9.928063183 podStartE2EDuration="42.534636416s" totalImagesPullingTime="32.606573233s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:08.531755693 +0000 UTC m=+42.746768488" watchObservedRunningTime="2026-08-04 15:07:08.534636416 +0000 UTC m=+42.749649212"
Aug 04 15:07:08.553019 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.552979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-n9b96" podStartSLOduration=2.561393736 podStartE2EDuration="4.552967142s" totalImagesPullingTime="1.991573406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:08.55226971 +0000 UTC m=+42.767282506" watchObservedRunningTime="2026-08-04 15:07:08.552967142 +0000 UTC m=+42.767979933"
Aug 04 15:07:08.936842 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.936803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:08.936989 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:08.936886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:08.936989 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.936950    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 04 15:07:08.936989 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.936971    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59ff746887-t8sd6: secret "image-registry-tls" not found
Aug 04 15:07:08.937121 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.937026    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls podName:688dca57-b71a-46c0-a1ad-b95613da205b nodeName:}" failed. No retries permitted until 2026-08-04 15:07:16.937012097 +0000 UTC m=+51.152024874 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls") pod "image-registry-59ff746887-t8sd6" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b") : secret "image-registry-tls" not found
Aug 04 15:07:08.937121 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.937044    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 04 15:07:08.937121 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:08.937088    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls podName:d46cb900-8fa0-45d4-a6a9-786659633dc7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:16.937075782 +0000 UTC m=+51.152088555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls") pod "dns-default-j5kq2" (UID: "d46cb900-8fa0-45d4-a6a9-786659633dc7") : secret "dns-default-metrics-tls" not found
Aug 04 15:07:11.512923 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:11.512889    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs" event={"ID":"2af4db0d-68d3-477f-ba5a-5f6d0309bb65","Type":"ContainerStarted","Data":"e9a5818d2febd864141e7438f42bc59bf99465debc17ebc14592b139e8e390e3"}
Aug 04 15:07:11.533704 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:11.533644    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-98c88fbb5-mrvrs" podStartSLOduration=1.994613122 podStartE2EDuration="4.533628691s" totalImagesPullingTime="2.539015569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:11.532896425 +0000 UTC m=+45.747909220" watchObservedRunningTime="2026-08-04 15:07:11.533628691 +0000 UTC m=+45.748641488"
Aug 04 15:07:12.062719 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:12.062673    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:12.063123 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:12.063101    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:12.063378 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:12.063364    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:12.063524 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:07:12.063513    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls podName:1d1b8299-929e-4359-a39e-7633d034be0e nodeName:}" failed. No retries permitted until 2026-08-04 15:07:20.063481489 +0000 UTC m=+54.278494266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wjj2j" (UID: "1d1b8299-929e-4359-a39e-7633d034be0e") : secret "insights-runtime-extractor-tls" not found
Aug 04 15:07:12.064497 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:12.064472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1d1b8299-929e-4359-a39e-7633d034be0e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:17.004993 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.004954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:17.005483 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.005026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:17.007424 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.007402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d46cb900-8fa0-45d4-a6a9-786659633dc7-metrics-tls\") pod \"dns-default-j5kq2\" (UID: \"d46cb900-8fa0-45d4-a6a9-786659633dc7\") " pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:17.007561 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.007519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"image-registry-59ff746887-t8sd6\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") " pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:17.090492 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.090462    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:17.109874 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.109840    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:17.300331 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.300186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59ff746887-t8sd6"]
Aug 04 15:07:17.303635 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:17.303600    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688dca57_b71a_46c0_a1ad_b95613da205b.slice/crio-e699b27d3f0ff701bd1482e360ddf5376b0b7801a897a9bbe2753fd1c4340dac WatchSource:0}: Error finding container e699b27d3f0ff701bd1482e360ddf5376b0b7801a897a9bbe2753fd1c4340dac: Status 404 returned error can't find the container with id e699b27d3f0ff701bd1482e360ddf5376b0b7801a897a9bbe2753fd1c4340dac
Aug 04 15:07:17.309139 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.309116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j5kq2"]
Aug 04 15:07:17.314426 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:17.314401    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46cb900_8fa0_45d4_a6a9_786659633dc7.slice/crio-a0d49fb4907652c0b6c962b70a13d7b1f4c27e10ef5a85078290c83ed2ec93ee WatchSource:0}: Error finding container a0d49fb4907652c0b6c962b70a13d7b1f4c27e10ef5a85078290c83ed2ec93ee: Status 404 returned error can't find the container with id a0d49fb4907652c0b6c962b70a13d7b1f4c27e10ef5a85078290c83ed2ec93ee
Aug 04 15:07:17.529391 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.529353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59ff746887-t8sd6" event={"ID":"688dca57-b71a-46c0-a1ad-b95613da205b","Type":"ContainerStarted","Data":"776f97297030a7ddc9b183ee02552bb63581e0e78a1d2e30a797cfa4fddfdc05"}
Aug 04 15:07:17.529617 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.529443    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59ff746887-t8sd6" event={"ID":"688dca57-b71a-46c0-a1ad-b95613da205b","Type":"ContainerStarted","Data":"e699b27d3f0ff701bd1482e360ddf5376b0b7801a897a9bbe2753fd1c4340dac"}
Aug 04 15:07:17.529617 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.529470    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:17.530427 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.530404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5kq2" event={"ID":"d46cb900-8fa0-45d4-a6a9-786659633dc7","Type":"ContainerStarted","Data":"a0d49fb4907652c0b6c962b70a13d7b1f4c27e10ef5a85078290c83ed2ec93ee"}
Aug 04 15:07:17.559719 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:17.559626    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59ff746887-t8sd6" podStartSLOduration=32.559608215 podStartE2EDuration="32.559608215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:17.558855717 +0000 UTC m=+51.773868514" watchObservedRunningTime="2026-08-04 15:07:17.559608215 +0000 UTC m=+51.774620988"
Aug 04 15:07:20.128854 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.128763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:20.132778 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.132745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1d1b8299-929e-4359-a39e-7633d034be0e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wjj2j\" (UID: \"1d1b8299-929e-4359-a39e-7633d034be0e\") " pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:20.171623 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.171596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wjj2j"
Aug 04 15:07:20.325324 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.325292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wjj2j"]
Aug 04 15:07:20.328267 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:20.328245    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1b8299_929e_4359_a39e_7633d034be0e.slice/crio-c4c479264b6d1570f9de5359fc0c257dbf7bce87db4dedd47b87896c031840ea WatchSource:0}: Error finding container c4c479264b6d1570f9de5359fc0c257dbf7bce87db4dedd47b87896c031840ea: Status 404 returned error can't find the container with id c4c479264b6d1570f9de5359fc0c257dbf7bce87db4dedd47b87896c031840ea
Aug 04 15:07:20.540819 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.540724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjj2j" event={"ID":"1d1b8299-929e-4359-a39e-7633d034be0e","Type":"ContainerStarted","Data":"6a26135b2cbf1e806e3025d688e4d45111c55086a545b8e209bac5a0a8a6edd8"}
Aug 04 15:07:20.540819 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.540785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjj2j" event={"ID":"1d1b8299-929e-4359-a39e-7633d034be0e","Type":"ContainerStarted","Data":"c4c479264b6d1570f9de5359fc0c257dbf7bce87db4dedd47b87896c031840ea"}
Aug 04 15:07:20.542497 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.542473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5kq2" event={"ID":"d46cb900-8fa0-45d4-a6a9-786659633dc7","Type":"ContainerStarted","Data":"2883cd559d1a86c641dfd3d0b5501756cb319f57e89cb0498455346e46cdd8ba"}
Aug 04 15:07:20.542654 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.542516    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5kq2" event={"ID":"d46cb900-8fa0-45d4-a6a9-786659633dc7","Type":"ContainerStarted","Data":"86dbb494dd12ec7f6e9e1f854f9d713f105f39c357d3dc56cdf50e230f80158c"}
Aug 04 15:07:20.542654 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.542598    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:20.576336 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:20.576290    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j5kq2" podStartSLOduration=16.935048889 podStartE2EDuration="19.576272105s" totalImagesPullingTime="2.641223216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:20.574654836 +0000 UTC m=+54.789667632" watchObservedRunningTime="2026-08-04 15:07:20.576272105 +0000 UTC m=+54.791284897"
Aug 04 15:07:21.548602 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:21.548567    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjj2j" event={"ID":"1d1b8299-929e-4359-a39e-7633d034be0e","Type":"ContainerStarted","Data":"9e8d1366973c68d8a7263d913fa028589178abdecdecfd9d39d55f2c811fd89c"}
Aug 04 15:07:22.553350 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:22.553315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wjj2j" event={"ID":"1d1b8299-929e-4359-a39e-7633d034be0e","Type":"ContainerStarted","Data":"dc89b4102352b8673299d36d418683f17b39eb4bb70717ca3a7d936a4007b4a7"}
Aug 04 15:07:22.574952 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:22.574901    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wjj2j" podStartSLOduration=16.621446084 podStartE2EDuration="18.574885903s" totalImagesPullingTime="1.953439819s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:07:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:22.573079736 +0000 UTC m=+56.788092529" watchObservedRunningTime="2026-08-04 15:07:22.574885903 +0000 UTC m=+56.789898695"
Aug 04 15:07:26.471716 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:26.471687    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-flfvl"
Aug 04 15:07:30.551366 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:30.551325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j5kq2"
Aug 04 15:07:31.419784 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.419753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"]
Aug 04 15:07:31.423364 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.423346    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.432433 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.432414    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 04 15:07:31.433839 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.433823    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 04 15:07:31.433930 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.433848    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 04 15:07:31.436926 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.436908    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 04 15:07:31.441630 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.441599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 04 15:07:31.441630 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.441628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 04 15:07:31.447109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.447093    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 04 15:07:31.464013 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.463987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"]
Aug 04 15:07:31.500525 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.500490    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59ff746887-t8sd6"]
Aug 04 15:07:31.510777 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.510738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.510777 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.510781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwmk2\" (UniqueName: \"kubernetes.io/projected/dfcb0551-0f04-4479-871c-95e23358c368-kube-api-access-hwmk2\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.510968 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.510802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcb0551-0f04-4479-871c-95e23358c368-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.510968 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.510888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-hub\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.510968 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.510941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.511060 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.511009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-ca\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.612300 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.612267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.612807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.612311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwmk2\" (UniqueName: \"kubernetes.io/projected/dfcb0551-0f04-4479-871c-95e23358c368-kube-api-access-hwmk2\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.612807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.612335    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcb0551-0f04-4479-871c-95e23358c368-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.612807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.612548    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-hub\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.612807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.612601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.612807 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.612622    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-ca\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.613172 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.613150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dfcb0551-0f04-4479-871c-95e23358c368-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.615197 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.615174    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-hub\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.615298 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.615203    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.615436 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.615419    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-ca\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.615507 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.615488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dfcb0551-0f04-4479-871c-95e23358c368-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.623917 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.623892    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-557b744bcb-lfq9d"]
Aug 04 15:07:31.626449 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.626421    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"]
Aug 04 15:07:31.626549 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.626516    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.628525 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.628508    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-4b5ff"]
Aug 04 15:07:31.628645 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.628596    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:31.630659 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.630644    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:31.634232 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.634215    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 15:07:31.634762 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.634719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4v864\""
Aug 04 15:07:31.634863 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.634849    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 15:07:31.636608 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.636595    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 04 15:07:31.636859 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.636845    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4n6d5\""
Aug 04 15:07:31.641925 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.641908    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwmk2\" (UniqueName: \"kubernetes.io/projected/dfcb0551-0f04-4479-871c-95e23358c368-kube-api-access-hwmk2\") pod \"cluster-proxy-proxy-agent-6577d44ff6-bcdpc\" (UID: \"dfcb0551-0f04-4479-871c-95e23358c368\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.650362 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.650341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"]
Aug 04 15:07:31.657962 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.657937    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-4b5ff"]
Aug 04 15:07:31.658760 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.658734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-557b744bcb-lfq9d"]
Aug 04 15:07:31.712976 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.712890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz77d\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-kube-api-access-mz77d\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.712976 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.712924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4wx\" (UniqueName: \"kubernetes.io/projected/051358b0-92c2-4bd2-bc39-fa68fc169124-kube-api-access-tx4wx\") pod \"downloads-77c974ffcf-4b5ff\" (UID: \"051358b0-92c2-4bd2-bc39-fa68fc169124\") " pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:31.712976 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.712968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-installation-pull-secrets\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.713195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-registry-tls\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.713195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d159d623-cdbd-42ce-8dbd-08f14094e36e-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-cgkj4\" (UID: \"d159d623-cdbd-42ce-8dbd-08f14094e36e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:31.713195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-registry-certificates\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.713195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-trusted-ca\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.713195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-ca-trust-extracted\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.713195 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-bound-sa-token\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.713560 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.713196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-image-registry-private-configuration\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.744653 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.744619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"
Aug 04 15:07:31.814081 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-image-registry-private-configuration\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814256 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz77d\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-kube-api-access-mz77d\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814256 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4wx\" (UniqueName: \"kubernetes.io/projected/051358b0-92c2-4bd2-bc39-fa68fc169124-kube-api-access-tx4wx\") pod \"downloads-77c974ffcf-4b5ff\" (UID: \"051358b0-92c2-4bd2-bc39-fa68fc169124\") " pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:31.814256 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-installation-pull-secrets\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814460 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-registry-tls\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814615 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d159d623-cdbd-42ce-8dbd-08f14094e36e-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-cgkj4\" (UID: \"d159d623-cdbd-42ce-8dbd-08f14094e36e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:31.814767 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-registry-certificates\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814767 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-trusted-ca\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814767 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-ca-trust-extracted\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.814767 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.814735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-bound-sa-token\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.815915 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.815763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-ca-trust-extracted\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.815915 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.815871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-registry-certificates\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.816071 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.815999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-trusted-ca\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.816909 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.816888    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-image-registry-private-configuration\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.817298 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.817279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-installation-pull-secrets\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.817655 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.817638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d159d623-cdbd-42ce-8dbd-08f14094e36e-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-cgkj4\" (UID: \"d159d623-cdbd-42ce-8dbd-08f14094e36e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:31.817966 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.817944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-registry-tls\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.834327 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.834289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-bound-sa-token\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.835208 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.835175    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4wx\" (UniqueName: \"kubernetes.io/projected/051358b0-92c2-4bd2-bc39-fa68fc169124-kube-api-access-tx4wx\") pod \"downloads-77c974ffcf-4b5ff\" (UID: \"051358b0-92c2-4bd2-bc39-fa68fc169124\") " pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:31.835208 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.835192    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz77d\" (UniqueName: \"kubernetes.io/projected/53e10a0f-ae4e-4a49-9fec-cff7b73d60d5-kube-api-access-mz77d\") pod \"image-registry-557b744bcb-lfq9d\" (UID: \"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5\") " pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.895131 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.895102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc"]
Aug 04 15:07:31.896272 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:31.896247    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfcb0551_0f04_4479_871c_95e23358c368.slice/crio-ff7730ec1be84c192388ba91f1557b56864b2faf8ab0e8b369c5382634b5f455 WatchSource:0}: Error finding container ff7730ec1be84c192388ba91f1557b56864b2faf8ab0e8b369c5382634b5f455: Status 404 returned error can't find the container with id ff7730ec1be84c192388ba91f1557b56864b2faf8ab0e8b369c5382634b5f455
Aug 04 15:07:31.936477 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.936441    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:31.942284 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.942265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:31.952157 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:31.952135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:32.113321 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.113290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-557b744bcb-lfq9d"]
Aug 04 15:07:32.116591 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.116452    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"]
Aug 04 15:07:32.116774 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.116746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:32.116906 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.116808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:07:32.116906 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.116871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:07:32.117154 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:32.117109    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53e10a0f_ae4e_4a49_9fec_cff7b73d60d5.slice/crio-d886c1776c875a4587a364151fc39e67a99290851939e07acdad41059aecb8dd WatchSource:0}: Error finding container d886c1776c875a4587a364151fc39e67a99290851939e07acdad41059aecb8dd: Status 404 returned error can't find the container with id d886c1776c875a4587a364151fc39e67a99290851939e07acdad41059aecb8dd
Aug 04 15:07:32.119134 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:32.119112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd159d623_cdbd_42ce_8dbd_08f14094e36e.slice/crio-c14f1c44a82f0e4eeec32c5d0dc77c906a4bbb1057ac19294c27d65d64f67438 WatchSource:0}: Error finding container c14f1c44a82f0e4eeec32c5d0dc77c906a4bbb1057ac19294c27d65d64f67438: Status 404 returned error can't find the container with id c14f1c44a82f0e4eeec32c5d0dc77c906a4bbb1057ac19294c27d65d64f67438
Aug 04 15:07:32.122029 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.122009    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 15:07:32.122146 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.122106    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 15:07:32.122235 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.122217    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 15:07:32.127759 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.127716    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-4b5ff"]
Aug 04 15:07:32.129477 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.129454    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f3296a-efb8-49c2-8bc6-34602a69c91f-metrics-certs\") pod \"network-metrics-daemon-jh8wj\" (UID: \"06f3296a-efb8-49c2-8bc6-34602a69c91f\") " pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:07:32.129611 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.129513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6cf35354-ac57-4479-906c-20c8a2243e10-original-pull-secret\") pod \"global-pull-secret-syncer-mtnjh\" (UID: \"6cf35354-ac57-4479-906c-20c8a2243e10\") " pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:07:32.129678 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:32.129638    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051358b0_92c2_4bd2_bc39_fa68fc169124.slice/crio-fd21a5dca8727228fd18eb1d6a8ad4113d9e56dc06309925d7093a8ad6cceb74 WatchSource:0}: Error finding container fd21a5dca8727228fd18eb1d6a8ad4113d9e56dc06309925d7093a8ad6cceb74: Status 404 returned error can't find the container with id fd21a5dca8727228fd18eb1d6a8ad4113d9e56dc06309925d7093a8ad6cceb74
Aug 04 15:07:32.130720 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.130695    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 15:07:32.139781 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.139761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8szw\" (UniqueName: \"kubernetes.io/projected/11f2ecf7-5630-4d3b-a680-7ccc0fa7254d-kube-api-access-d8szw\") pod \"network-check-target-r9n6s\" (UID: \"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d\") " pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:32.312589 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.312502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm4b6\""
Aug 04 15:07:32.318463 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.318444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mtnjh"
Aug 04 15:07:32.320024 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.319997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:32.329209 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.329184    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8z69l\""
Aug 04 15:07:32.335191 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.335151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jh8wj"
Aug 04 15:07:32.525397 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:32.525371    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f2ecf7_5630_4d3b_a680_7ccc0fa7254d.slice/crio-f077e669b532aaa5558093196980a1a8489dc2f6e47aac0c74c8936187f3c366 WatchSource:0}: Error finding container f077e669b532aaa5558093196980a1a8489dc2f6e47aac0c74c8936187f3c366: Status 404 returned error can't find the container with id f077e669b532aaa5558093196980a1a8489dc2f6e47aac0c74c8936187f3c366
Aug 04 15:07:32.535961 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.535932    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r9n6s"]
Aug 04 15:07:32.589642 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.589550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r9n6s" event={"ID":"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d","Type":"ContainerStarted","Data":"f077e669b532aaa5558093196980a1a8489dc2f6e47aac0c74c8936187f3c366"}
Aug 04 15:07:32.591570 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.591522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d" event={"ID":"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5","Type":"ContainerStarted","Data":"2377db666ca212297a5d0e63e86f3c4fbad1343f19355185ee7d206bcf6d581d"}
Aug 04 15:07:32.591668 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.591596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d" event={"ID":"53e10a0f-ae4e-4a49-9fec-cff7b73d60d5","Type":"ContainerStarted","Data":"d886c1776c875a4587a364151fc39e67a99290851939e07acdad41059aecb8dd"}
Aug 04 15:07:32.592358 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.592337    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:32.593905 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.593881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4" event={"ID":"d159d623-cdbd-42ce-8dbd-08f14094e36e","Type":"ContainerStarted","Data":"c14f1c44a82f0e4eeec32c5d0dc77c906a4bbb1057ac19294c27d65d64f67438"}
Aug 04 15:07:32.595984 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.595964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc" event={"ID":"dfcb0551-0f04-4479-871c-95e23358c368","Type":"ContainerStarted","Data":"ff7730ec1be84c192388ba91f1557b56864b2faf8ab0e8b369c5382634b5f455"}
Aug 04 15:07:32.597213 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.597196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-4b5ff" event={"ID":"051358b0-92c2-4bd2-bc39-fa68fc169124","Type":"ContainerStarted","Data":"fd21a5dca8727228fd18eb1d6a8ad4113d9e56dc06309925d7093a8ad6cceb74"}
Aug 04 15:07:32.663937 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.663871    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d" podStartSLOduration=1.66384905 podStartE2EDuration="1.66384905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:32.663599304 +0000 UTC m=+66.878612098" watchObservedRunningTime="2026-08-04 15:07:32.66384905 +0000 UTC m=+66.878861847"
Aug 04 15:07:32.717921 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.717889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mtnjh"]
Aug 04 15:07:32.722390 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:32.722351    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf35354_ac57_4479_906c_20c8a2243e10.slice/crio-a9f9f097265ccf15670ee74b8a60c127d0d7bd520b814561b491b997d941c399 WatchSource:0}: Error finding container a9f9f097265ccf15670ee74b8a60c127d0d7bd520b814561b491b997d941c399: Status 404 returned error can't find the container with id a9f9f097265ccf15670ee74b8a60c127d0d7bd520b814561b491b997d941c399
Aug 04 15:07:32.723989 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:32.723960    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jh8wj"]
Aug 04 15:07:32.728295 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:32.727164    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f3296a_efb8_49c2_8bc6_34602a69c91f.slice/crio-b9b87e85b2fefae4521711b97fdd96d15ea902681f66107da66bf66002e56111 WatchSource:0}: Error finding container b9b87e85b2fefae4521711b97fdd96d15ea902681f66107da66bf66002e56111: Status 404 returned error can't find the container with id b9b87e85b2fefae4521711b97fdd96d15ea902681f66107da66bf66002e56111
Aug 04 15:07:33.608618 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:33.608497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtnjh" event={"ID":"6cf35354-ac57-4479-906c-20c8a2243e10","Type":"ContainerStarted","Data":"a9f9f097265ccf15670ee74b8a60c127d0d7bd520b814561b491b997d941c399"}
Aug 04 15:07:33.611717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:33.611598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jh8wj" event={"ID":"06f3296a-efb8-49c2-8bc6-34602a69c91f","Type":"ContainerStarted","Data":"b9b87e85b2fefae4521711b97fdd96d15ea902681f66107da66bf66002e56111"}
Aug 04 15:07:40.644063 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.644019    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4" event={"ID":"d159d623-cdbd-42ce-8dbd-08f14094e36e","Type":"ContainerStarted","Data":"59a0df05caaef485f6bdcc49bf3fd9d62670aa6ba562696c26ae66137ae16db0"}
Aug 04 15:07:40.644506 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.644254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:40.646129 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.646099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mtnjh" event={"ID":"6cf35354-ac57-4479-906c-20c8a2243e10","Type":"ContainerStarted","Data":"9056b744eac8528c7d4fce6c180a5109589a02b0f944acbd50b4ecbdb2aa9424"}
Aug 04 15:07:40.648905 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.648877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc" event={"ID":"dfcb0551-0f04-4479-871c-95e23358c368","Type":"ContainerStarted","Data":"3d6f4366650957827a0b495f53f1334be278aa703642780467f8fd676302f54d"}
Aug 04 15:07:40.649025 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.648941    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc" event={"ID":"dfcb0551-0f04-4479-871c-95e23358c368","Type":"ContainerStarted","Data":"6b49b826df6ac34bb531e0b241e99ddcc48d36a4ce59b58088d8e3b72fec8d7d"}
Aug 04 15:07:40.649025 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.648964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc" event={"ID":"dfcb0551-0f04-4479-871c-95e23358c368","Type":"ContainerStarted","Data":"eb845cee11ad624f69405cd747af9612488a229e8ecc1b6560371e8f223244c7"}
Aug 04 15:07:40.650408 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.650381    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4"
Aug 04 15:07:40.651013 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.650990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jh8wj" event={"ID":"06f3296a-efb8-49c2-8bc6-34602a69c91f","Type":"ContainerStarted","Data":"d9d536acb58ad737c53be6961d70fc8b634ba4d7669e766468d2dcccd38da721"}
Aug 04 15:07:40.651013 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.651039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jh8wj" event={"ID":"06f3296a-efb8-49c2-8bc6-34602a69c91f","Type":"ContainerStarted","Data":"f70dc135dba7270b05d1e0dd88028bcca08100cd0ad73f4a2bf76a2944c24875"}
Aug 04 15:07:40.652645 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.652618    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r9n6s" event={"ID":"11f2ecf7-5630-4d3b-a680-7ccc0fa7254d","Type":"ContainerStarted","Data":"00914b8f3b2d710b582c26ba055106b7bc353b56d59cd1ca90506825ba5833f6"}
Aug 04 15:07:40.652765 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.652749    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:07:40.680018 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.679966    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-cgkj4" podStartSLOduration=1.9361640279999999 podStartE2EDuration="9.679944106s" totalImagesPullingTime="7.743780078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:40.675117534 +0000 UTC m=+74.890130331" watchObservedRunningTime="2026-08-04 15:07:40.679944106 +0000 UTC m=+74.894956905"
Aug 04 15:07:40.737376 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.737332    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jh8wj" podStartSLOduration=67.284652072 podStartE2EDuration="1m14.737312695s" totalImagesPullingTime="7.452660623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:40.736262721 +0000 UTC m=+74.951275518" watchObservedRunningTime="2026-08-04 15:07:40.737312695 +0000 UTC m=+74.952325489"
Aug 04 15:07:40.807222 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:40.807156    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6577d44ff6-bcdpc" podStartSLOduration=1.840997413 podStartE2EDuration="9.807140248s" totalImagesPullingTime="7.966142835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:40.797834081 +0000 UTC m=+75.012846878" watchObservedRunningTime="2026-08-04 15:07:40.807140248 +0000 UTC m=+75.022153043"
Aug 04 15:07:41.016550 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:41.016474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r9n6s" podStartSLOduration=67.679716508 podStartE2EDuration="1m15.016456493s" totalImagesPullingTime="7.336739985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:41.016010805 +0000 UTC m=+75.231023601" watchObservedRunningTime="2026-08-04 15:07:41.016456493 +0000 UTC m=+75.231469289"
Aug 04 15:07:41.055554 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:41.055486    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mtnjh" podStartSLOduration=67.599715785 podStartE2EDuration="1m15.055469094s" totalImagesPullingTime="7.455753309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:41.055406076 +0000 UTC m=+75.270418873" watchObservedRunningTime="2026-08-04 15:07:41.055469094 +0000 UTC m=+75.270481887"
Aug 04 15:07:41.508018 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:41.507985    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:48.777194 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.776019    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xkdff"]
Aug 04 15:07:48.780552 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.780515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.786887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.785921    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 15:07:48.786887 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.786840    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 15:07:48.787099 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.786911    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 15:07:48.788302 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.788076    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 15:07:48.788302 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.788091    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c87cf\""
Aug 04 15:07:48.788302 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.788233    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 15:07:48.788507 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.788324    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 15:07:48.853058 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-textfile\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853058 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-wtmp\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853284 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-root\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853284 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-tls\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853284 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853237    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9v7x\" (UniqueName: \"kubernetes.io/projected/62f85030-004b-4bd9-942e-87400f537e74-kube-api-access-f9v7x\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-accelerators-collector-config\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853330    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853350    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-sys\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.853417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.853396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f85030-004b-4bd9-942e-87400f537e74-metrics-client-ca\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954689 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-root\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954869 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-tls\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954869 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9v7x\" (UniqueName: \"kubernetes.io/projected/62f85030-004b-4bd9-942e-87400f537e74-kube-api-access-f9v7x\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954869 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-root\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954869 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-accelerators-collector-config\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954869 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.954869 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-sys\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955062 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f85030-004b-4bd9-942e-87400f537e74-metrics-client-ca\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955062 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-textfile\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955062 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.954942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-wtmp\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955153 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.955094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-wtmp\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955153 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.955103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62f85030-004b-4bd9-942e-87400f537e74-sys\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955721 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.955694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-accelerators-collector-config\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955843 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.955814    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f85030-004b-4bd9-942e-87400f537e74-metrics-client-ca\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.955949 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.955916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-textfile\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.957463 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.957441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-tls\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.957791 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.957769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f85030-004b-4bd9-942e-87400f537e74-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:48.968762 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:48.968739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9v7x\" (UniqueName: \"kubernetes.io/projected/62f85030-004b-4bd9-942e-87400f537e74-kube-api-access-f9v7x\") pod \"node-exporter-xkdff\" (UID: \"62f85030-004b-4bd9-942e-87400f537e74\") " pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:49.094172 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:49.094080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xkdff"
Aug 04 15:07:51.664514 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:07:51.664486    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f85030_004b_4bd9_942e_87400f537e74.slice/crio-d86b5f1e67312fcfe7125493bcaf8deae8f75a233d902fb2443c369fbc4f79f3 WatchSource:0}: Error finding container d86b5f1e67312fcfe7125493bcaf8deae8f75a233d902fb2443c369fbc4f79f3: Status 404 returned error can't find the container with id d86b5f1e67312fcfe7125493bcaf8deae8f75a233d902fb2443c369fbc4f79f3
Aug 04 15:07:51.699593 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:51.699545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkdff" event={"ID":"62f85030-004b-4bd9-942e-87400f537e74","Type":"ContainerStarted","Data":"d86b5f1e67312fcfe7125493bcaf8deae8f75a233d902fb2443c369fbc4f79f3"}
Aug 04 15:07:52.706213 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:52.706045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-4b5ff" event={"ID":"051358b0-92c2-4bd2-bc39-fa68fc169124","Type":"ContainerStarted","Data":"269da1563ee53884b17112165e8cbe34ae2dc448772818655109754181c56eb2"}
Aug 04 15:07:52.742256 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:52.742087    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-4b5ff" podStartSLOduration=1.80387148 podStartE2EDuration="21.742062797s" totalImagesPullingTime="19.938191317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:52.740490059 +0000 UTC m=+86.955502854" watchObservedRunningTime="2026-08-04 15:07:52.742062797 +0000 UTC m=+86.957075591"
Aug 04 15:07:53.711813 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:53.711777    2581 generic.go:356] "Generic (PLEG): container finished" podID="62f85030-004b-4bd9-942e-87400f537e74" containerID="d250619e68bd7410d0af890d8f5cc08652fa21ab7624bdb9138dd9eea2df38f0" exitCode=0
Aug 04 15:07:53.712255 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:53.711858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkdff" event={"ID":"62f85030-004b-4bd9-942e-87400f537e74","Type":"ContainerDied","Data":"d250619e68bd7410d0af890d8f5cc08652fa21ab7624bdb9138dd9eea2df38f0"}
Aug 04 15:07:53.712255 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:53.712176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:53.728576 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:53.728552    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-4b5ff"
Aug 04 15:07:54.623070 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:54.623033    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-557b744bcb-lfq9d"
Aug 04 15:07:54.720018 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:54.719983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkdff" event={"ID":"62f85030-004b-4bd9-942e-87400f537e74","Type":"ContainerStarted","Data":"2b9d5450dd9faa75bf6445b4f13c92acc53eb445104c4f39216a07243b52a26b"}
Aug 04 15:07:54.720447 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:54.720048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xkdff" event={"ID":"62f85030-004b-4bd9-942e-87400f537e74","Type":"ContainerStarted","Data":"a5a08e265dce5cd7c77f09b0e29cf6f1cbfc458ab2c5a47e58eeeebd75138ae3"}
Aug 04 15:07:54.743985 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:54.743924    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xkdff" podStartSLOduration=5.419811727 podStartE2EDuration="6.743902562s" totalImagesPullingTime="1.240955254s" totalInitContainerRuntime="83.135581ms" isStatefulPod=true podCreationTimestamp="2026-08-04 15:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:54.743310238 +0000 UTC m=+88.958323037" watchObservedRunningTime="2026-08-04 15:07:54.743902562 +0000 UTC m=+88.958915358"
Aug 04 15:07:56.519909 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.519825    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59ff746887-t8sd6" podUID="688dca57-b71a-46c0-a1ad-b95613da205b" containerName="registry" containerID="cri-o://776f97297030a7ddc9b183ee02552bb63581e0e78a1d2e30a797cfa4fddfdc05" gracePeriod=30
Aug 04 15:07:56.732376 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.730847    2581 generic.go:356] "Generic (PLEG): container finished" podID="688dca57-b71a-46c0-a1ad-b95613da205b" containerID="776f97297030a7ddc9b183ee02552bb63581e0e78a1d2e30a797cfa4fddfdc05" exitCode=0
Aug 04 15:07:56.732376 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.730969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59ff746887-t8sd6" event={"ID":"688dca57-b71a-46c0-a1ad-b95613da205b","Type":"ContainerDied","Data":"776f97297030a7ddc9b183ee02552bb63581e0e78a1d2e30a797cfa4fddfdc05"}
Aug 04 15:07:56.821617 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.821582    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:56.922226 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922193    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv25j\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-kube-api-access-sv25j\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922419 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922250    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/688dca57-b71a-46c0-a1ad-b95613da205b-ca-trust-extracted\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922419 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922294    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-installation-pull-secrets\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922419 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922333    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-registry-certificates\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922419 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922358    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922419 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922390    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-image-registry-private-configuration\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922739 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-bound-sa-token\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.922739 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.922629    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-trusted-ca\") pod \"688dca57-b71a-46c0-a1ad-b95613da205b\" (UID: \"688dca57-b71a-46c0-a1ad-b95613da205b\") "
Aug 04 15:07:56.923360 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.923325    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:07:56.925846 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.925524    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:07:56.925846 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.925765    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-kube-api-access-sv25j" (OuterVolumeSpecName: "kube-api-access-sv25j") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "kube-api-access-sv25j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:07:56.926604 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.926570    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:07:56.927032 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.926994    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:07:56.927886 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.927859    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:07:56.928905 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.928879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:07:56.932713 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:56.932688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/688dca57-b71a-46c0-a1ad-b95613da205b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "688dca57-b71a-46c0-a1ad-b95613da205b" (UID: "688dca57-b71a-46c0-a1ad-b95613da205b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:07:57.023422 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023381    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-installation-pull-secrets\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023422 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023417    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-registry-certificates\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023422 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023428    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-registry-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023438    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/688dca57-b71a-46c0-a1ad-b95613da205b-image-registry-private-configuration\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023451    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-bound-sa-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023465    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/688dca57-b71a-46c0-a1ad-b95613da205b-trusted-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023477    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv25j\" (UniqueName: \"kubernetes.io/projected/688dca57-b71a-46c0-a1ad-b95613da205b-kube-api-access-sv25j\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.023733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.023489    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/688dca57-b71a-46c0-a1ad-b95613da205b-ca-trust-extracted\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:07:57.736611 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.736575    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59ff746887-t8sd6"
Aug 04 15:07:57.737077 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.736575    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59ff746887-t8sd6" event={"ID":"688dca57-b71a-46c0-a1ad-b95613da205b","Type":"ContainerDied","Data":"e699b27d3f0ff701bd1482e360ddf5376b0b7801a897a9bbe2753fd1c4340dac"}
Aug 04 15:07:57.737077 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.736729    2581 scope.go:117] "RemoveContainer" containerID="776f97297030a7ddc9b183ee02552bb63581e0e78a1d2e30a797cfa4fddfdc05"
Aug 04 15:07:57.772714 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.772682    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59ff746887-t8sd6"]
Aug 04 15:07:57.781630 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:57.781597    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59ff746887-t8sd6"]
Aug 04 15:07:58.302295 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:07:58.302266    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="688dca57-b71a-46c0-a1ad-b95613da205b" path="/var/lib/kubelet/pods/688dca57-b71a-46c0-a1ad-b95613da205b/volumes"
Aug 04 15:08:11.659825 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:08:11.659794    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r9n6s"
Aug 04 15:08:19.568052 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:08:19.568016    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7f2tt_75f9a334-cb62-4030-9008-32c2c225241b/serve-healthcheck-canary/0.log"
Aug 04 15:11:16.523602 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.523569    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"]
Aug 04 15:11:16.524036 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.523830    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="688dca57-b71a-46c0-a1ad-b95613da205b" containerName="registry"
Aug 04 15:11:16.524036 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.523840    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="688dca57-b71a-46c0-a1ad-b95613da205b" containerName="registry"
Aug 04 15:11:16.524036 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.523886    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="688dca57-b71a-46c0-a1ad-b95613da205b" containerName="registry"
Aug 04 15:11:16.526637 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.526620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.530344 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.530315    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2hzw5\""
Aug 04 15:11:16.530860 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.530842    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 04 15:11:16.531016 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.531001    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:11:16.544664 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.544645    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"]
Aug 04 15:11:16.655834 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.655790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b51912-9ea2-45a7-8838-56966fcad445-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cgffh\" (UID: \"36b51912-9ea2-45a7-8838-56966fcad445\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.655834 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.655832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8g6w\" (UniqueName: \"kubernetes.io/projected/36b51912-9ea2-45a7-8838-56966fcad445-kube-api-access-z8g6w\") pod \"cert-manager-operator-controller-manager-55c444bf86-cgffh\" (UID: \"36b51912-9ea2-45a7-8838-56966fcad445\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.756883 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.756850    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b51912-9ea2-45a7-8838-56966fcad445-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cgffh\" (UID: \"36b51912-9ea2-45a7-8838-56966fcad445\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.756997 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.756886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8g6w\" (UniqueName: \"kubernetes.io/projected/36b51912-9ea2-45a7-8838-56966fcad445-kube-api-access-z8g6w\") pod \"cert-manager-operator-controller-manager-55c444bf86-cgffh\" (UID: \"36b51912-9ea2-45a7-8838-56966fcad445\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.757219 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.757202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36b51912-9ea2-45a7-8838-56966fcad445-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-cgffh\" (UID: \"36b51912-9ea2-45a7-8838-56966fcad445\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.769083 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.769053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8g6w\" (UniqueName: \"kubernetes.io/projected/36b51912-9ea2-45a7-8838-56966fcad445-kube-api-access-z8g6w\") pod \"cert-manager-operator-controller-manager-55c444bf86-cgffh\" (UID: \"36b51912-9ea2-45a7-8838-56966fcad445\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.835243 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.835165    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"
Aug 04 15:11:16.969813 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:16.969787    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh"]
Aug 04 15:11:16.972936 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:11:16.972909    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b51912_9ea2_45a7_8838_56966fcad445.slice/crio-e0cd075574595c2eb1206e2d4602ecbb333437fb5356896f0c1eaf8f95fd6893 WatchSource:0}: Error finding container e0cd075574595c2eb1206e2d4602ecbb333437fb5356896f0c1eaf8f95fd6893: Status 404 returned error can't find the container with id e0cd075574595c2eb1206e2d4602ecbb333437fb5356896f0c1eaf8f95fd6893
Aug 04 15:11:17.398983 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:17.398950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh" event={"ID":"36b51912-9ea2-45a7-8838-56966fcad445","Type":"ContainerStarted","Data":"e0cd075574595c2eb1206e2d4602ecbb333437fb5356896f0c1eaf8f95fd6893"}
Aug 04 15:11:20.413245 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:20.413207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh" event={"ID":"36b51912-9ea2-45a7-8838-56966fcad445","Type":"ContainerStarted","Data":"d0b8b02b76cbc3db3a452d1a12ca5fbeea9b44afe2a86bbdef47bc46fea38c6b"}
Aug 04 15:11:20.438660 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:20.438607    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-cgffh" podStartSLOduration=1.8147451239999999 podStartE2EDuration="4.438591047s" totalImagesPullingTime="2.623845923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:20.438148918 +0000 UTC m=+294.653161715" watchObservedRunningTime="2026-08-04 15:11:20.438591047 +0000 UTC m=+294.653603843"
Aug 04 15:11:26.207931 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:11:26.207903    2581 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 15:12:15.220632 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.220591    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"]
Aug 04 15:12:15.223668 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.223645    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.226776 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.226757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 15:12:15.226776 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.226767    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 15:12:15.226970 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.226846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 15:12:15.228122 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.228097    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:12:15.228225 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.228186    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 15:12:15.228934 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.228904    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fs4r4\""
Aug 04 15:12:15.243402 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.243372    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"]
Aug 04 15:12:15.287223 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.287188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38d163f6-df6a-4a8d-8776-519601340e49-cert\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.287423 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.287231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hszwc\" (UniqueName: \"kubernetes.io/projected/38d163f6-df6a-4a8d-8776-519601340e49-kube-api-access-hszwc\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.287423 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.287263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38d163f6-df6a-4a8d-8776-519601340e49-manager-config\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.287423 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.287351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/38d163f6-df6a-4a8d-8776-519601340e49-metrics-cert\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.388333 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.388293    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/38d163f6-df6a-4a8d-8776-519601340e49-metrics-cert\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.388527 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.388356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38d163f6-df6a-4a8d-8776-519601340e49-cert\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.388527 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.388374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hszwc\" (UniqueName: \"kubernetes.io/projected/38d163f6-df6a-4a8d-8776-519601340e49-kube-api-access-hszwc\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.388527 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.388403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38d163f6-df6a-4a8d-8776-519601340e49-manager-config\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.389141 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.389121    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/38d163f6-df6a-4a8d-8776-519601340e49-manager-config\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.390971 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.390947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/38d163f6-df6a-4a8d-8776-519601340e49-metrics-cert\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.391059 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.391041    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38d163f6-df6a-4a8d-8776-519601340e49-cert\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.398099 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.398068    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hszwc\" (UniqueName: \"kubernetes.io/projected/38d163f6-df6a-4a8d-8776-519601340e49-kube-api-access-hszwc\") pod \"lws-controller-manager-598d546c6b-xrf4n\" (UID: \"38d163f6-df6a-4a8d-8776-519601340e49\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.533207 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.533110    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:15.673091 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.673052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"]
Aug 04 15:12:15.675867 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:12:15.675838    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38d163f6_df6a_4a8d_8776_519601340e49.slice/crio-503220675ec02e253d9aa805d1f1a136f9b6e984e56e347c4303418ed634f36c WatchSource:0}: Error finding container 503220675ec02e253d9aa805d1f1a136f9b6e984e56e347c4303418ed634f36c: Status 404 returned error can't find the container with id 503220675ec02e253d9aa805d1f1a136f9b6e984e56e347c4303418ed634f36c
Aug 04 15:12:15.677786 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:15.677772    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:12:16.616628 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:16.616586    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n" event={"ID":"38d163f6-df6a-4a8d-8776-519601340e49","Type":"ContainerStarted","Data":"503220675ec02e253d9aa805d1f1a136f9b6e984e56e347c4303418ed634f36c"}
Aug 04 15:12:18.625944 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:18.625850    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n" event={"ID":"38d163f6-df6a-4a8d-8776-519601340e49","Type":"ContainerStarted","Data":"60e0f202f7f5817722be5d1b2fe59538ff792c503c771eaacc1ea1a0fd5d12a2"}
Aug 04 15:12:18.626295 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:18.625967    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:18.644819 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:18.644767    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n" podStartSLOduration=0.982591968 podStartE2EDuration="3.644752512s" totalImagesPullingTime="2.662160544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:18.643591895 +0000 UTC m=+352.858604689" watchObservedRunningTime="2026-08-04 15:12:18.644752512 +0000 UTC m=+352.859765307"
Aug 04 15:12:27.213311 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.213273    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"]
Aug 04 15:12:27.216541 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.216514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.220056 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.220027    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 15:12:27.222876 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.222712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2c586\""
Aug 04 15:12:27.223227 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.223206    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 15:12:27.223634 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.223459    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 15:12:27.223634 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.223459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 15:12:27.278256 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.278226    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hzmx\" (UniqueName: \"kubernetes.io/projected/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-kube-api-access-7hzmx\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.278378 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.278260    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.278378 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.278299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-manifests\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.278378 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.278349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-tmp\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.278378 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.278371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.332008 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.331978    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"]
Aug 04 15:12:27.378915 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.378878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-tmp\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.379056 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.378921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.379056 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.378964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hzmx\" (UniqueName: \"kubernetes.io/projected/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-kube-api-access-7hzmx\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.379178 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.379131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.379231 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.379212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-manifests\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.379552 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.379508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-manifests\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.381278 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.381258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-tmp\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.381650 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.381629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.381708 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.381648    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-webhook-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.396116 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.396094    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hzmx\" (UniqueName: \"kubernetes.io/projected/5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e-kube-api-access-7hzmx\") pod \"opendatahub-operator-controller-manager-764fcd8dc-gxbl8\" (UID: \"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.527134 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.527041    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:27.667302 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:27.667280    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"]
Aug 04 15:12:27.669434 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:12:27.669408    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae9fd5f_7dcb_49b3_8b29_1e6c11d47e6e.slice/crio-7363944a5dab412100200afb44a0d8f658bbfe37bab2631e2ca9a055375a63f3 WatchSource:0}: Error finding container 7363944a5dab412100200afb44a0d8f658bbfe37bab2631e2ca9a055375a63f3: Status 404 returned error can't find the container with id 7363944a5dab412100200afb44a0d8f658bbfe37bab2631e2ca9a055375a63f3
Aug 04 15:12:28.662985 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:28.662951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8" event={"ID":"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e","Type":"ContainerStarted","Data":"7363944a5dab412100200afb44a0d8f658bbfe37bab2631e2ca9a055375a63f3"}
Aug 04 15:12:29.632425 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:29.632383    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-xrf4n"
Aug 04 15:12:31.678721 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:31.678682    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8" event={"ID":"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e","Type":"ContainerStarted","Data":"dad77e4c0c3c2ec821ad67a2ef136788fcd6f24c7e0111e1327667f2ffb40169"}
Aug 04 15:12:32.684467 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:32.684440    2581 generic.go:356] "Generic (PLEG): container finished" podID="5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e" containerID="dad77e4c0c3c2ec821ad67a2ef136788fcd6f24c7e0111e1327667f2ffb40169" exitCode=0
Aug 04 15:12:32.684855 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:32.684475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8" event={"ID":"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e","Type":"ContainerDied","Data":"dad77e4c0c3c2ec821ad67a2ef136788fcd6f24c7e0111e1327667f2ffb40169"}
Aug 04 15:12:33.690309 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:33.690272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8" event={"ID":"5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e","Type":"ContainerStarted","Data":"9e24747885d18c5ab691796091785d26e2518b2a83ff7839f4e4e6819655812f"}
Aug 04 15:12:33.690787 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:33.690405    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:33.723556 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:33.723490    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8" podStartSLOduration=1.461872405 podStartE2EDuration="6.723475265s" totalImagesPullingTime="4.183995565s" totalInitContainerRuntime="1.077607295s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:33.722121856 +0000 UTC m=+367.937134654" watchObservedRunningTime="2026-08-04 15:12:33.723475265 +0000 UTC m=+367.938488061"
Aug 04 15:12:44.696156 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:44.696124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-gxbl8"
Aug 04 15:12:56.043227 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.043193    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"]
Aug 04 15:12:56.047716 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.047692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.050998 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.050975    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 15:12:56.051116 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.051004    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 15:12:56.051331 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.051305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 04 15:12:56.051331 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.051309    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 04 15:12:56.051477 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.051333    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 04 15:12:56.051477 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.051313    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 04 15:12:56.051746 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.051731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-z4f8l\""
Aug 04 15:12:56.061508 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.061485    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"]
Aug 04 15:12:56.215485 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.215485 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215501    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.215793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.215793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxjc9\" (UniqueName: \"kubernetes.io/projected/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-kube-api-access-zxjc9\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.215793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.215793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215704    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.215793 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.215745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316208 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316208 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxjc9\" (UniqueName: \"kubernetes.io/projected/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-kube-api-access-zxjc9\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316208 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316504 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316504 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316235    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316504 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316504 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.316884 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.316856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.318861 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.318832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.318970 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.318904    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.319144 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.319124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.319202 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.319148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.341227 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.341196    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.357021 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.356994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxjc9\" (UniqueName: \"kubernetes.io/projected/bab4ecc2-9d40-4614-9e90-ea1bd32992f7-kube-api-access-zxjc9\") pod \"istiod-openshift-gateway-5677ccb49b-qkcw9\" (UID: \"bab4ecc2-9d40-4614-9e90-ea1bd32992f7\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.657128 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.657083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:12:56.833373 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:56.833340    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"]
Aug 04 15:12:56.836624 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:12:56.836594    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbab4ecc2_9d40_4614_9e90_ea1bd32992f7.slice/crio-ada9b305e6d26a14d3e5eca7ec1abb357821c7db31e661c37455a87353eedd0b WatchSource:0}: Error finding container ada9b305e6d26a14d3e5eca7ec1abb357821c7db31e661c37455a87353eedd0b: Status 404 returned error can't find the container with id ada9b305e6d26a14d3e5eca7ec1abb357821c7db31e661c37455a87353eedd0b
Aug 04 15:12:57.791775 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:57.791724    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9" event={"ID":"bab4ecc2-9d40-4614-9e90-ea1bd32992f7","Type":"ContainerStarted","Data":"ada9b305e6d26a14d3e5eca7ec1abb357821c7db31e661c37455a87353eedd0b"}
Aug 04 15:12:59.447496 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:59.447458    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 15:12:59.447873 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:59.447555    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 15:12:59.804335 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:59.804250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9" event={"ID":"bab4ecc2-9d40-4614-9e90-ea1bd32992f7","Type":"ContainerStarted","Data":"e65b20664b94a8e6aa14010d501d301efe0e8754bc093791a0c58ba90030554e"}
Aug 04 15:12:59.804490 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:12:59.804380    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:13:00.809927 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:13:00.809898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9"
Aug 04 15:13:00.873477 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:13:00.873420    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qkcw9" podStartSLOduration=2.264678602 podStartE2EDuration="4.873402409s" totalImagesPullingTime="2.608723807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:59.871425275 +0000 UTC m=+394.086438072" watchObservedRunningTime="2026-08-04 15:13:00.873402409 +0000 UTC m=+395.088415205"
Aug 04 15:14:48.009327 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.009294    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"]
Aug 04 15:14:48.012507 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.012490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.016371 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.016351    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 15:14:48.016472 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.016389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 15:14:48.016688 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.016672    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fmv6n\""
Aug 04 15:14:48.031969 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.031940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"]
Aug 04 15:14:48.071058 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.071016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79dh\" (UniqueName: \"kubernetes.io/projected/6a07b372-3fa3-4176-b571-37ccb63e879e-kube-api-access-m79dh\") pod \"kuadrant-operator-controller-manager-86878c769f-8484n\" (UID: \"6a07b372-3fa3-4176-b571-37ccb63e879e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.071241 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.071070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a07b372-3fa3-4176-b571-37ccb63e879e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8484n\" (UID: \"6a07b372-3fa3-4176-b571-37ccb63e879e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.136169 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.136130    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"]
Aug 04 15:14:48.136401 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:14:48.136381    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-m79dh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n" podUID="6a07b372-3fa3-4176-b571-37ccb63e879e"
Aug 04 15:14:48.139441 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.139415    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"]
Aug 04 15:14:48.164107 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.164076    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"]
Aug 04 15:14:48.167390 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.167193    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.172384 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.172358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a07b372-3fa3-4176-b571-37ccb63e879e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8484n\" (UID: \"6a07b372-3fa3-4176-b571-37ccb63e879e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.172488 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.172466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79dh\" (UniqueName: \"kubernetes.io/projected/6a07b372-3fa3-4176-b571-37ccb63e879e-kube-api-access-m79dh\") pod \"kuadrant-operator-controller-manager-86878c769f-8484n\" (UID: \"6a07b372-3fa3-4176-b571-37ccb63e879e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.172733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.172715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a07b372-3fa3-4176-b571-37ccb63e879e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8484n\" (UID: \"6a07b372-3fa3-4176-b571-37ccb63e879e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.178075 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:14:48.178057    2581 projected.go:196] Error preparing data for projected volume kube-api-access-m79dh for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-8484n" not found
Aug 04 15:14:48.178160 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:14:48.178112    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6a07b372-3fa3-4176-b571-37ccb63e879e-kube-api-access-m79dh podName:6a07b372-3fa3-4176-b571-37ccb63e879e nodeName:}" failed. No retries permitted until 2026-08-04 15:14:48.678097604 +0000 UTC m=+502.893110379 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m79dh" (UniqueName: "kubernetes.io/projected/6a07b372-3fa3-4176-b571-37ccb63e879e-kube-api-access-m79dh") pod "kuadrant-operator-controller-manager-86878c769f-8484n" (UID: "6a07b372-3fa3-4176-b571-37ccb63e879e") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-8484n" not found
Aug 04 15:14:48.188340 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.188316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"]
Aug 04 15:14:48.223211 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.223181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.226966 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:14:48.226933    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-8484n\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="6a07b372-3fa3-4176-b571-37ccb63e879e" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.229782 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.229766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.232507 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:14:48.232483    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-8484n\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="6a07b372-3fa3-4176-b571-37ccb63e879e" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:48.273019 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.272931    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a07b372-3fa3-4176-b571-37ccb63e879e-extensions-socket-volume\") pod \"6a07b372-3fa3-4176-b571-37ccb63e879e\" (UID: \"6a07b372-3fa3-4176-b571-37ccb63e879e\") "
Aug 04 15:14:48.273169 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.273085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nchwb\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.273238 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.273186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk6g5\" (UniqueName: \"kubernetes.io/projected/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-kube-api-access-hk6g5\") pod \"kuadrant-operator-controller-manager-86878c769f-nchwb\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.273238 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.273191    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a07b372-3fa3-4176-b571-37ccb63e879e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6a07b372-3fa3-4176-b571-37ccb63e879e" (UID: "6a07b372-3fa3-4176-b571-37ccb63e879e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:14:48.273334 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.273264    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a07b372-3fa3-4176-b571-37ccb63e879e-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:14:48.273334 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.273281    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m79dh\" (UniqueName: \"kubernetes.io/projected/6a07b372-3fa3-4176-b571-37ccb63e879e-kube-api-access-m79dh\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:14:48.301077 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.301034    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a07b372-3fa3-4176-b571-37ccb63e879e" path="/var/lib/kubelet/pods/6a07b372-3fa3-4176-b571-37ccb63e879e/volumes"
Aug 04 15:14:48.373826 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.373781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk6g5\" (UniqueName: \"kubernetes.io/projected/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-kube-api-access-hk6g5\") pod \"kuadrant-operator-controller-manager-86878c769f-nchwb\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.373826 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.373834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nchwb\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.374189 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.374172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nchwb\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.386825 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.386786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk6g5\" (UniqueName: \"kubernetes.io/projected/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-kube-api-access-hk6g5\") pod \"kuadrant-operator-controller-manager-86878c769f-nchwb\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.477429 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.477398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:48.621664 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:48.621636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"]
Aug 04 15:14:48.624624 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:14:48.624594    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f2ac18_cb46_4b9e_afd7_5125fad2c74b.slice/crio-b1cecdfe21cc5e3d74e956fcff416a736b9bd44ae86e09ee902898ca778cdae8 WatchSource:0}: Error finding container b1cecdfe21cc5e3d74e956fcff416a736b9bd44ae86e09ee902898ca778cdae8: Status 404 returned error can't find the container with id b1cecdfe21cc5e3d74e956fcff416a736b9bd44ae86e09ee902898ca778cdae8
Aug 04 15:14:49.229121 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:49.229085    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb" event={"ID":"61f2ac18-cb46-4b9e-afd7-5125fad2c74b","Type":"ContainerStarted","Data":"b1cecdfe21cc5e3d74e956fcff416a736b9bd44ae86e09ee902898ca778cdae8"}
Aug 04 15:14:49.229502 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:49.229098    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:49.234144 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:14:49.234118    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-8484n\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="6a07b372-3fa3-4176-b571-37ccb63e879e" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8484n"
Aug 04 15:14:54.253702 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:54.253669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb" event={"ID":"61f2ac18-cb46-4b9e-afd7-5125fad2c74b","Type":"ContainerStarted","Data":"7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c"}
Aug 04 15:14:54.254126 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:54.253786    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:14:54.278388 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:14:54.278331    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb" podStartSLOduration=1.680631371 podStartE2EDuration="6.278311124s" totalImagesPullingTime="4.597679753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:14:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:14:54.27674979 +0000 UTC m=+508.491762586" watchObservedRunningTime="2026-08-04 15:14:54.278311124 +0000 UTC m=+508.493323921"
Aug 04 15:15:05.259544 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:15:05.259507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:17:03.284287 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.284249    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"]
Aug 04 15:17:03.287090 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.287075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.291167 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.291144    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 15:17:03.291282 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.291167    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Aug 04 15:17:03.291282 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.291167    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 15:17:03.291282 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.291248    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l75xt\""
Aug 04 15:17:03.297391 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.297369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"]
Aug 04 15:17:03.384193 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.384154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.384193 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.384192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a1548d-b966-4711-92c7-82660873a886-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.384445 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.384220    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.384445 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.384318    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln2nr\" (UniqueName: \"kubernetes.io/projected/f8a1548d-b966-4711-92c7-82660873a886-kube-api-access-ln2nr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.384445 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.384346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.384605 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.384449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485296 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a1548d-b966-4711-92c7-82660873a886-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln2nr\" (UniqueName: \"kubernetes.io/projected/f8a1548d-b966-4711-92c7-82660873a886-kube-api-access-ln2nr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485466    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.485911 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.486030 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.486030 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.485970    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.487888 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.487867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8a1548d-b966-4711-92c7-82660873a886-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.488170 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.488150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8a1548d-b966-4711-92c7-82660873a886-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.494471 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.494437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln2nr\" (UniqueName: \"kubernetes.io/projected/f8a1548d-b966-4711-92c7-82660873a886-kube-api-access-ln2nr\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n\" (UID: \"f8a1548d-b966-4711-92c7-82660873a886\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.597746 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.597657    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:03.738746 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.738719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"]
Aug 04 15:17:03.741483 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:17:03.741445    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a1548d_b966_4711_92c7_82660873a886.slice/crio-5d949fc9ac00c1454c61a38195eb3ef8413b67930e83f799bf5c8c44cc2bd0d2 WatchSource:0}: Error finding container 5d949fc9ac00c1454c61a38195eb3ef8413b67930e83f799bf5c8c44cc2bd0d2: Status 404 returned error can't find the container with id 5d949fc9ac00c1454c61a38195eb3ef8413b67930e83f799bf5c8c44cc2bd0d2
Aug 04 15:17:03.768074 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:03.768041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n" event={"ID":"f8a1548d-b966-4711-92c7-82660873a886","Type":"ContainerStarted","Data":"5d949fc9ac00c1454c61a38195eb3ef8413b67930e83f799bf5c8c44cc2bd0d2"}
Aug 04 15:17:05.777956 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:05.777920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n" event={"ID":"f8a1548d-b966-4711-92c7-82660873a886","Type":"ContainerStarted","Data":"dbc07bae6f117b12354a317d58b65da98ddcf0615fa38ab0d4756c843795dd8b"}
Aug 04 15:17:05.799001 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:05.798952    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n" podStartSLOduration=1.685022135 podStartE2EDuration="2.79893782s" totalImagesPullingTime="1.113915685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:05.797509572 +0000 UTC m=+640.012522369" watchObservedRunningTime="2026-08-04 15:17:05.79893782 +0000 UTC m=+640.013950616"
Aug 04 15:17:13.598762 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:13.598704    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:13.601223 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:13.598796    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:13.611744 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:13.611719    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:13.819255 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:13.819224    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n"
Aug 04 15:17:30.181631 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.181592    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"]
Aug 04 15:17:30.186092 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.186069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.189087 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.189057    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Aug 04 15:17:30.196262 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.196238    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"]
Aug 04 15:17:30.315913 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.315880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdphr\" (UniqueName: \"kubernetes.io/projected/35d89b70-8279-4087-ba78-6b5a1aa8de0e-kube-api-access-sdphr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.315913 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.315917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.316168 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.315941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.316168 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.315958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35d89b70-8279-4087-ba78-6b5a1aa8de0e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.316168 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.316052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.316168 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.316115    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.416934 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.416901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdphr\" (UniqueName: \"kubernetes.io/projected/35d89b70-8279-4087-ba78-6b5a1aa8de0e-kube-api-access-sdphr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.416934 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.416939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.416963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.416979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35d89b70-8279-4087-ba78-6b5a1aa8de0e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.417027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417176 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.417075    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417415 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.417380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417526 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.417416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.417526 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.417454    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.419474 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.419448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35d89b70-8279-4087-ba78-6b5a1aa8de0e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.419746 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.419727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35d89b70-8279-4087-ba78-6b5a1aa8de0e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.425969 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.425949    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdphr\" (UniqueName: \"kubernetes.io/projected/35d89b70-8279-4087-ba78-6b5a1aa8de0e-kube-api-access-sdphr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-9ksxx\" (UID: \"35d89b70-8279-4087-ba78-6b5a1aa8de0e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.497441 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.497363    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:30.633599 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.633568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"]
Aug 04 15:17:30.635752 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:17:30.635726    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d89b70_8279_4087_ba78_6b5a1aa8de0e.slice/crio-4b02334bd7bbe12de3dbb3b9d3da961c6e997d6f707fa6b952114dd578fc0528 WatchSource:0}: Error finding container 4b02334bd7bbe12de3dbb3b9d3da961c6e997d6f707fa6b952114dd578fc0528: Status 404 returned error can't find the container with id 4b02334bd7bbe12de3dbb3b9d3da961c6e997d6f707fa6b952114dd578fc0528
Aug 04 15:17:30.637134 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.637113    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:17:30.877073 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:30.876984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx" event={"ID":"35d89b70-8279-4087-ba78-6b5a1aa8de0e","Type":"ContainerStarted","Data":"4b02334bd7bbe12de3dbb3b9d3da961c6e997d6f707fa6b952114dd578fc0528"}
Aug 04 15:17:31.882954 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:31.882904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx" event={"ID":"35d89b70-8279-4087-ba78-6b5a1aa8de0e","Type":"ContainerStarted","Data":"039e97fea1f3871edde0e8626ad6a59bdcce3ce45809cd70c7763ce9224109e9"}
Aug 04 15:17:31.903624 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:31.903567    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx" podStartSLOduration=1.650388007 podStartE2EDuration="1.90352137s" totalImagesPullingTime="253.133363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:31.90336114 +0000 UTC m=+666.118373935" watchObservedRunningTime="2026-08-04 15:17:31.90352137 +0000 UTC m=+666.118534165"
Aug 04 15:17:40.497984 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:40.497948    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:40.498374 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:40.498026    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:40.510840 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:40.510815    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:17:40.935891 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:17:40.935864    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-9ksxx"
Aug 04 15:28:27.941098 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:27.941039    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"]
Aug 04 15:28:27.943706 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:27.941281    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb" podUID="61f2ac18-cb46-4b9e-afd7-5125fad2c74b" containerName="manager" containerID="cri-o://7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c" gracePeriod=10
Aug 04 15:28:28.189190 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.189166    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:28:28.270646 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.270560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-extensions-socket-volume\") pod \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") "
Aug 04 15:28:28.270646 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.270618    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk6g5\" (UniqueName: \"kubernetes.io/projected/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-kube-api-access-hk6g5\") pod \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\" (UID: \"61f2ac18-cb46-4b9e-afd7-5125fad2c74b\") "
Aug 04 15:28:28.270927 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.270907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "61f2ac18-cb46-4b9e-afd7-5125fad2c74b" (UID: "61f2ac18-cb46-4b9e-afd7-5125fad2c74b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:28:28.272838 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.272815    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-kube-api-access-hk6g5" (OuterVolumeSpecName: "kube-api-access-hk6g5") pod "61f2ac18-cb46-4b9e-afd7-5125fad2c74b" (UID: "61f2ac18-cb46-4b9e-afd7-5125fad2c74b"). InnerVolumeSpecName "kube-api-access-hk6g5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:28:28.372062 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.372030    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:28:28.372062 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.372055    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk6g5\" (UniqueName: \"kubernetes.io/projected/61f2ac18-cb46-4b9e-afd7-5125fad2c74b-kube-api-access-hk6g5\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:28:28.591591 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.591495    2581 generic.go:356] "Generic (PLEG): container finished" podID="61f2ac18-cb46-4b9e-afd7-5125fad2c74b" containerID="7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c" exitCode=0
Aug 04 15:28:28.591591 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.591561    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"
Aug 04 15:28:28.591591 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.591570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb" event={"ID":"61f2ac18-cb46-4b9e-afd7-5125fad2c74b","Type":"ContainerDied","Data":"7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c"}
Aug 04 15:28:28.591909 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.591619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb" event={"ID":"61f2ac18-cb46-4b9e-afd7-5125fad2c74b","Type":"ContainerDied","Data":"b1cecdfe21cc5e3d74e956fcff416a736b9bd44ae86e09ee902898ca778cdae8"}
Aug 04 15:28:28.591909 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.591641    2581 scope.go:117] "RemoveContainer" containerID="7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c"
Aug 04 15:28:28.600749 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.600730    2581 scope.go:117] "RemoveContainer" containerID="7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c"
Aug 04 15:28:28.601032 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:28:28.601012    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c\": container with ID starting with 7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c not found: ID does not exist" containerID="7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c"
Aug 04 15:28:28.601087 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.601046    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c"} err="failed to get container status \"7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c\": rpc error: code = NotFound desc = could not find container \"7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c\": container with ID starting with 7f8b277e64f42b5fbb949c87b849c6025cde19a1699b829aa95ede9559fa1c9c not found: ID does not exist"
Aug 04 15:28:28.612445 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.612413    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"]
Aug 04 15:28:28.619297 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:28.619274    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nchwb"]
Aug 04 15:28:30.302440 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:28:30.302401    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61f2ac18-cb46-4b9e-afd7-5125fad2c74b" path="/var/lib/kubelet/pods/61f2ac18-cb46-4b9e-afd7-5125fad2c74b/volumes"
Aug 04 15:29:28.713274 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.713243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"]
Aug 04 15:29:28.713712 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.713514    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61f2ac18-cb46-4b9e-afd7-5125fad2c74b" containerName="manager"
Aug 04 15:29:28.713712 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.713525    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="61f2ac18-cb46-4b9e-afd7-5125fad2c74b" containerName="manager"
Aug 04 15:29:28.713712 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.713599    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="61f2ac18-cb46-4b9e-afd7-5125fad2c74b" containerName="manager"
Aug 04 15:29:28.716826 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.716807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:28.720415 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.720386    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 15:29:28.720785 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.720766    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 15:29:28.721105 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.721089    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fmv6n\""
Aug 04 15:29:28.735462 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.735436    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"]
Aug 04 15:29:28.771845 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.771812    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/140bd659-7ef7-406b-ab99-176437d1ba17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-722fw\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:28.772006 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.771853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccdb\" (UniqueName: \"kubernetes.io/projected/140bd659-7ef7-406b-ab99-176437d1ba17-kube-api-access-mccdb\") pod \"kuadrant-operator-controller-manager-86878c769f-722fw\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:28.872785 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.872747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/140bd659-7ef7-406b-ab99-176437d1ba17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-722fw\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:28.872785 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.872789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccdb\" (UniqueName: \"kubernetes.io/projected/140bd659-7ef7-406b-ab99-176437d1ba17-kube-api-access-mccdb\") pod \"kuadrant-operator-controller-manager-86878c769f-722fw\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:28.873157 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.873137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/140bd659-7ef7-406b-ab99-176437d1ba17-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-722fw\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:28.884336 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:28.884309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccdb\" (UniqueName: \"kubernetes.io/projected/140bd659-7ef7-406b-ab99-176437d1ba17-kube-api-access-mccdb\") pod \"kuadrant-operator-controller-manager-86878c769f-722fw\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:29.029995 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:29.029895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:29.169766 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:29.169734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"]
Aug 04 15:29:29.172516 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:29:29.172488    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod140bd659_7ef7_406b_ab99_176437d1ba17.slice/crio-3002f36db056d20270233caaa58b40d5616c8245c580c05e7d904023746423ae WatchSource:0}: Error finding container 3002f36db056d20270233caaa58b40d5616c8245c580c05e7d904023746423ae: Status 404 returned error can't find the container with id 3002f36db056d20270233caaa58b40d5616c8245c580c05e7d904023746423ae
Aug 04 15:29:29.832485 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:29.832454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw" event={"ID":"140bd659-7ef7-406b-ab99-176437d1ba17","Type":"ContainerStarted","Data":"27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d"}
Aug 04 15:29:29.832898 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:29.832503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw" event={"ID":"140bd659-7ef7-406b-ab99-176437d1ba17","Type":"ContainerStarted","Data":"3002f36db056d20270233caaa58b40d5616c8245c580c05e7d904023746423ae"}
Aug 04 15:29:29.832898 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:29.832552    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:29:29.857445 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:29.857398    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw" podStartSLOduration=1.857382711 podStartE2EDuration="1.857382711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:29:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:29:29.854884868 +0000 UTC m=+1384.069897663" watchObservedRunningTime="2026-08-04 15:29:29.857382711 +0000 UTC m=+1384.072395506"
Aug 04 15:29:40.838491 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:29:40.838455    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:38:16.090967 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.090930    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"]
Aug 04 15:38:16.094282 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.094260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:16.097431 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.097399    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:38:16.097555 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.097438    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:38:16.103696 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.103677    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"]
Aug 04 15:38:16.219165 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.219114    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e02c01-cb56-45b4-9431-f24202bba454-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj\" (UID: \"21e02c01-cb56-45b4-9431-f24202bba454\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:16.320496 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.320464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e02c01-cb56-45b4-9431-f24202bba454-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj\" (UID: \"21e02c01-cb56-45b4-9431-f24202bba454\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:16.321044 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.321025    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e02c01-cb56-45b4-9431-f24202bba454-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj\" (UID: \"21e02c01-cb56-45b4-9431-f24202bba454\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:16.405607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.405581    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:16.538665 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.538633    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"]
Aug 04 15:38:16.542278 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:38:16.542249    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e02c01_cb56_45b4_9431_f24202bba454.slice/crio-35127411746b5a928266f7db95d5f233fcfe188dc845c53294441872c1477653 WatchSource:0}: Error finding container 35127411746b5a928266f7db95d5f233fcfe188dc845c53294441872c1477653: Status 404 returned error can't find the container with id 35127411746b5a928266f7db95d5f233fcfe188dc845c53294441872c1477653
Aug 04 15:38:16.544512 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.544494    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:38:16.993868 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:16.993826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj" event={"ID":"21e02c01-cb56-45b4-9431-f24202bba454","Type":"ContainerStarted","Data":"35127411746b5a928266f7db95d5f233fcfe188dc845c53294441872c1477653"}
Aug 04 15:38:20.008228 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:20.008136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj" event={"ID":"21e02c01-cb56-45b4-9431-f24202bba454","Type":"ContainerStarted","Data":"1140c94d61a303595521c3ae307fa271fae469ab81df7172176898c0661ae1e4"}
Aug 04 15:38:20.028375 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:20.028329    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj" podStartSLOduration=1.213994201 podStartE2EDuration="4.028313869s" totalImagesPullingTime="2.814319668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:38:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:38:20.026799661 +0000 UTC m=+1914.241812457" watchObservedRunningTime="2026-08-04 15:38:20.028313869 +0000 UTC m=+1914.243326664"
Aug 04 15:38:21.014104 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:21.014066    2581 generic.go:356] "Generic (PLEG): container finished" podID="21e02c01-cb56-45b4-9431-f24202bba454" containerID="1140c94d61a303595521c3ae307fa271fae469ab81df7172176898c0661ae1e4" exitCode=0
Aug 04 15:38:21.014104 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:21.014104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj" event={"ID":"21e02c01-cb56-45b4-9431-f24202bba454","Type":"ContainerDied","Data":"1140c94d61a303595521c3ae307fa271fae469ab81df7172176898c0661ae1e4"}
Aug 04 15:38:22.150758 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:22.150732    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:22.276113 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:22.276027    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e02c01-cb56-45b4-9431-f24202bba454-maas-api-service-ca\") pod \"21e02c01-cb56-45b4-9431-f24202bba454\" (UID: \"21e02c01-cb56-45b4-9431-f24202bba454\") "
Aug 04 15:38:22.276375 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:22.276350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21e02c01-cb56-45b4-9431-f24202bba454-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21e02c01-cb56-45b4-9431-f24202bba454" (UID: "21e02c01-cb56-45b4-9431-f24202bba454"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:38:22.377005 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:22.376963    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21e02c01-cb56-45b4-9431-f24202bba454-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:38:23.028977 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:23.028946    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"
Aug 04 15:38:23.029152 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:23.028947    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj" event={"ID":"21e02c01-cb56-45b4-9431-f24202bba454","Type":"ContainerDied","Data":"35127411746b5a928266f7db95d5f233fcfe188dc845c53294441872c1477653"}
Aug 04 15:38:23.029152 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:23.029065    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35127411746b5a928266f7db95d5f233fcfe188dc845c53294441872c1477653"
Aug 04 15:38:32.810044 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:32.810010    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"]
Aug 04 15:38:32.818331 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:32.818306    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-dc6f2748-jpcsj"]
Aug 04 15:38:34.301911 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:38:34.301879    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e02c01-cb56-45b4-9431-f24202bba454" path="/var/lib/kubelet/pods/21e02c01-cb56-45b4-9431-f24202bba454/volumes"
Aug 04 15:39:01.815775 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.815735    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"]
Aug 04 15:39:01.816209 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.816031    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e02c01-cb56-45b4-9431-f24202bba454" containerName="revoke-keys"
Aug 04 15:39:01.816209 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.816041    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e02c01-cb56-45b4-9431-f24202bba454" containerName="revoke-keys"
Aug 04 15:39:01.816209 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.816092    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e02c01-cb56-45b4-9431-f24202bba454" containerName="revoke-keys"
Aug 04 15:39:01.819003 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.818978    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:01.821897 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.821871    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:39:01.822054 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.821924    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:39:01.827938 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.827870    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"]
Aug 04 15:39:01.917240 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:01.912693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b246a314-09c6-4ac4-8838-38d86ebb97eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj\" (UID: \"b246a314-09c6-4ac4-8838-38d86ebb97eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:02.013609 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:02.013561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b246a314-09c6-4ac4-8838-38d86ebb97eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj\" (UID: \"b246a314-09c6-4ac4-8838-38d86ebb97eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:02.014208 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:02.014185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b246a314-09c6-4ac4-8838-38d86ebb97eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj\" (UID: \"b246a314-09c6-4ac4-8838-38d86ebb97eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:02.131632 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:02.131513    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:02.276325 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:02.276289    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"]
Aug 04 15:39:02.279240 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:39:02.279204    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb246a314_09c6_4ac4_8838_38d86ebb97eb.slice/crio-7b0df94718723cb16f4e2677963394819b5abc13853ebba7c34e3745165a826e WatchSource:0}: Error finding container 7b0df94718723cb16f4e2677963394819b5abc13853ebba7c34e3745165a826e: Status 404 returned error can't find the container with id 7b0df94718723cb16f4e2677963394819b5abc13853ebba7c34e3745165a826e
Aug 04 15:39:03.193775 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:03.193738    2581 generic.go:356] "Generic (PLEG): container finished" podID="b246a314-09c6-4ac4-8838-38d86ebb97eb" containerID="d6e0ceb6fb6aa40db898a6f48f5134e411763e7de20b6ececb1cb9228031ebc2" exitCode=0
Aug 04 15:39:03.194155 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:03.193799    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj" event={"ID":"b246a314-09c6-4ac4-8838-38d86ebb97eb","Type":"ContainerDied","Data":"d6e0ceb6fb6aa40db898a6f48f5134e411763e7de20b6ececb1cb9228031ebc2"}
Aug 04 15:39:03.194155 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:03.193843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj" event={"ID":"b246a314-09c6-4ac4-8838-38d86ebb97eb","Type":"ContainerStarted","Data":"7b0df94718723cb16f4e2677963394819b5abc13853ebba7c34e3745165a826e"}
Aug 04 15:39:04.342649 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:04.342625    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:04.433914 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:04.433881    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b246a314-09c6-4ac4-8838-38d86ebb97eb-maas-api-service-ca\") pod \"b246a314-09c6-4ac4-8838-38d86ebb97eb\" (UID: \"b246a314-09c6-4ac4-8838-38d86ebb97eb\") "
Aug 04 15:39:04.434233 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:04.434208    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b246a314-09c6-4ac4-8838-38d86ebb97eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b246a314-09c6-4ac4-8838-38d86ebb97eb" (UID: "b246a314-09c6-4ac4-8838-38d86ebb97eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:04.534697 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:04.534606    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b246a314-09c6-4ac4-8838-38d86ebb97eb-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:39:05.202736 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:05.202706    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"
Aug 04 15:39:05.202930 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:05.202741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj" event={"ID":"b246a314-09c6-4ac4-8838-38d86ebb97eb","Type":"ContainerDied","Data":"7b0df94718723cb16f4e2677963394819b5abc13853ebba7c34e3745165a826e"}
Aug 04 15:39:05.202930 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:05.202782    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b0df94718723cb16f4e2677963394819b5abc13853ebba7c34e3745165a826e"
Aug 04 15:39:08.895422 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:08.895381    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"]
Aug 04 15:39:08.900775 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:08.900751    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-2a0c7713-nc4zj"]
Aug 04 15:39:10.302177 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:10.302137    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b246a314-09c6-4ac4-8838-38d86ebb97eb" path="/var/lib/kubelet/pods/b246a314-09c6-4ac4-8838-38d86ebb97eb/volumes"
Aug 04 15:39:38.816725 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.816644    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"]
Aug 04 15:39:38.817184 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.816944    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b246a314-09c6-4ac4-8838-38d86ebb97eb" containerName="revoke-keys"
Aug 04 15:39:38.817184 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.816956    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b246a314-09c6-4ac4-8838-38d86ebb97eb" containerName="revoke-keys"
Aug 04 15:39:38.817184 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.817014    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b246a314-09c6-4ac4-8838-38d86ebb97eb" containerName="revoke-keys"
Aug 04 15:39:38.820009 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.819989    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:38.824327 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.824305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:39:38.824430 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.824371    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:39:38.829729 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.829699    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"]
Aug 04 15:39:38.916949 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:38.916913    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7231168-cea6-4160-9ba9-e9d6d8031cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5\" (UID: \"d7231168-cea6-4160-9ba9-e9d6d8031cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:39.017820 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:39.017779    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7231168-cea6-4160-9ba9-e9d6d8031cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5\" (UID: \"d7231168-cea6-4160-9ba9-e9d6d8031cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:39.018410 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:39.018388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7231168-cea6-4160-9ba9-e9d6d8031cd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5\" (UID: \"d7231168-cea6-4160-9ba9-e9d6d8031cd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:39.131820 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:39.131737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:39.276243 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:39.276216    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"]
Aug 04 15:39:39.278893 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:39:39.278865    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7231168_cea6_4160_9ba9_e9d6d8031cd1.slice/crio-6c17712cd47331c24700210e369fba5091db5cbfc53ada14d22cac58e60324ab WatchSource:0}: Error finding container 6c17712cd47331c24700210e369fba5091db5cbfc53ada14d22cac58e60324ab: Status 404 returned error can't find the container with id 6c17712cd47331c24700210e369fba5091db5cbfc53ada14d22cac58e60324ab
Aug 04 15:39:39.343010 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:39.342973    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5" event={"ID":"d7231168-cea6-4160-9ba9-e9d6d8031cd1","Type":"ContainerStarted","Data":"6c17712cd47331c24700210e369fba5091db5cbfc53ada14d22cac58e60324ab"}
Aug 04 15:39:40.348983 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:40.348947    2581 generic.go:356] "Generic (PLEG): container finished" podID="d7231168-cea6-4160-9ba9-e9d6d8031cd1" containerID="727e06a905491989490cfa276e34d6a1de283919b38148db3b1454eb51d3aeb6" exitCode=0
Aug 04 15:39:40.349353 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:40.349031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5" event={"ID":"d7231168-cea6-4160-9ba9-e9d6d8031cd1","Type":"ContainerDied","Data":"727e06a905491989490cfa276e34d6a1de283919b38148db3b1454eb51d3aeb6"}
Aug 04 15:39:41.476229 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:41.476204    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:41.535967 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:41.535935    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7231168-cea6-4160-9ba9-e9d6d8031cd1-maas-api-service-ca\") pod \"d7231168-cea6-4160-9ba9-e9d6d8031cd1\" (UID: \"d7231168-cea6-4160-9ba9-e9d6d8031cd1\") "
Aug 04 15:39:41.536341 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:41.536313    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7231168-cea6-4160-9ba9-e9d6d8031cd1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d7231168-cea6-4160-9ba9-e9d6d8031cd1" (UID: "d7231168-cea6-4160-9ba9-e9d6d8031cd1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:41.636998 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:41.636970    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7231168-cea6-4160-9ba9-e9d6d8031cd1-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:39:42.358241 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:42.358209    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5" event={"ID":"d7231168-cea6-4160-9ba9-e9d6d8031cd1","Type":"ContainerDied","Data":"6c17712cd47331c24700210e369fba5091db5cbfc53ada14d22cac58e60324ab"}
Aug 04 15:39:42.358396 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:42.358262    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c17712cd47331c24700210e369fba5091db5cbfc53ada14d22cac58e60324ab"
Aug 04 15:39:42.358396 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:42.358225    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"
Aug 04 15:39:45.099835 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:45.099790    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"]
Aug 04 15:39:45.107278 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:45.107252    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8202ac71-ntwg5"]
Aug 04 15:39:46.303635 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:39:46.303593    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7231168-cea6-4160-9ba9-e9d6d8031cd1" path="/var/lib/kubelet/pods/d7231168-cea6-4160-9ba9-e9d6d8031cd1/volumes"
Aug 04 15:40:15.135102 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.135068    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"]
Aug 04 15:40:15.135601 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.135350    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7231168-cea6-4160-9ba9-e9d6d8031cd1" containerName="revoke-keys"
Aug 04 15:40:15.135601 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.135360    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7231168-cea6-4160-9ba9-e9d6d8031cd1" containerName="revoke-keys"
Aug 04 15:40:15.135601 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.135421    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7231168-cea6-4160-9ba9-e9d6d8031cd1" containerName="revoke-keys"
Aug 04 15:40:15.138330 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.138314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:15.141301 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.141276    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:40:15.141804 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.141786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:40:15.160570 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.160543    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"]
Aug 04 15:40:15.225849 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.225815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722078ed-fe35-460a-888a-9917c6a73d53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0f33af57-jprjq\" (UID: \"722078ed-fe35-460a-888a-9917c6a73d53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:15.326703 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.326670    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722078ed-fe35-460a-888a-9917c6a73d53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0f33af57-jprjq\" (UID: \"722078ed-fe35-460a-888a-9917c6a73d53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:15.327345 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.327324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722078ed-fe35-460a-888a-9917c6a73d53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-0f33af57-jprjq\" (UID: \"722078ed-fe35-460a-888a-9917c6a73d53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:15.448179 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.448094    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:15.587414 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:15.587374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"]
Aug 04 15:40:15.593564 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:40:15.593501    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722078ed_fe35_460a_888a_9917c6a73d53.slice/crio-7dfd2974b97ae322eb6fb9eafef6004a9946254c2a3a37cec1345890cf5b4f3c WatchSource:0}: Error finding container 7dfd2974b97ae322eb6fb9eafef6004a9946254c2a3a37cec1345890cf5b4f3c: Status 404 returned error can't find the container with id 7dfd2974b97ae322eb6fb9eafef6004a9946254c2a3a37cec1345890cf5b4f3c
Aug 04 15:40:16.502890 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:16.502803    2581 generic.go:356] "Generic (PLEG): container finished" podID="722078ed-fe35-460a-888a-9917c6a73d53" containerID="a84f410aea2eba7ca3f6f5cf45ba60d401e418ec21be590733f7346be5fa207f" exitCode=0
Aug 04 15:40:16.503236 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:16.502883    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq" event={"ID":"722078ed-fe35-460a-888a-9917c6a73d53","Type":"ContainerDied","Data":"a84f410aea2eba7ca3f6f5cf45ba60d401e418ec21be590733f7346be5fa207f"}
Aug 04 15:40:16.503236 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:16.502934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq" event={"ID":"722078ed-fe35-460a-888a-9917c6a73d53","Type":"ContainerStarted","Data":"7dfd2974b97ae322eb6fb9eafef6004a9946254c2a3a37cec1345890cf5b4f3c"}
Aug 04 15:40:17.632933 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:17.632909    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:17.745079 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:17.745038    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722078ed-fe35-460a-888a-9917c6a73d53-maas-api-service-ca\") pod \"722078ed-fe35-460a-888a-9917c6a73d53\" (UID: \"722078ed-fe35-460a-888a-9917c6a73d53\") "
Aug 04 15:40:17.745412 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:17.745388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/722078ed-fe35-460a-888a-9917c6a73d53-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "722078ed-fe35-460a-888a-9917c6a73d53" (UID: "722078ed-fe35-460a-888a-9917c6a73d53"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:40:17.846597 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:17.846485    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/722078ed-fe35-460a-888a-9917c6a73d53-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:40:18.512108 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:18.512081    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"
Aug 04 15:40:18.512275 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:18.512072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq" event={"ID":"722078ed-fe35-460a-888a-9917c6a73d53","Type":"ContainerDied","Data":"7dfd2974b97ae322eb6fb9eafef6004a9946254c2a3a37cec1345890cf5b4f3c"}
Aug 04 15:40:18.512275 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:18.512197    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dfd2974b97ae322eb6fb9eafef6004a9946254c2a3a37cec1345890cf5b4f3c"
Aug 04 15:40:22.349649 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:22.349612    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"]
Aug 04 15:40:22.353107 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:22.353074    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-0f33af57-jprjq"]
Aug 04 15:40:24.301260 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:40:24.301226    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="722078ed-fe35-460a-888a-9917c6a73d53" path="/var/lib/kubelet/pods/722078ed-fe35-460a-888a-9917c6a73d53/volumes"
Aug 04 15:43:13.230450 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.230412    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"]
Aug 04 15:43:13.231083 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.230888    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="722078ed-fe35-460a-888a-9917c6a73d53" containerName="revoke-keys"
Aug 04 15:43:13.231083 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.230907    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="722078ed-fe35-460a-888a-9917c6a73d53" containerName="revoke-keys"
Aug 04 15:43:13.231083 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.231002    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="722078ed-fe35-460a-888a-9917c6a73d53" containerName="revoke-keys"
Aug 04 15:43:13.234000 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.233978    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:13.236837 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.236818    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:43:13.237615 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.237598    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:43:13.242660 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.242639    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"]
Aug 04 15:43:13.397839 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.397804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b77e12b3-4449-4ced-8a75-9d24a1bcb62e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb\" (UID: \"b77e12b3-4449-4ced-8a75-9d24a1bcb62e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:13.498451 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.498365    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b77e12b3-4449-4ced-8a75-9d24a1bcb62e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb\" (UID: \"b77e12b3-4449-4ced-8a75-9d24a1bcb62e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:13.499019 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.498994    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b77e12b3-4449-4ced-8a75-9d24a1bcb62e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb\" (UID: \"b77e12b3-4449-4ced-8a75-9d24a1bcb62e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:13.544947 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.544921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:13.678354 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:13.678324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"]
Aug 04 15:43:13.680247 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:43:13.680216    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77e12b3_4449_4ced_8a75_9d24a1bcb62e.slice/crio-2647f4cf1a06bb2da4762ac6aaa8cd69edd6ee54a54111b4bfe349bce34a2559 WatchSource:0}: Error finding container 2647f4cf1a06bb2da4762ac6aaa8cd69edd6ee54a54111b4bfe349bce34a2559: Status 404 returned error can't find the container with id 2647f4cf1a06bb2da4762ac6aaa8cd69edd6ee54a54111b4bfe349bce34a2559
Aug 04 15:43:14.268844 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:14.268806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb" event={"ID":"b77e12b3-4449-4ced-8a75-9d24a1bcb62e","Type":"ContainerStarted","Data":"7cc0669ad75a4c18399a297f44ef869a2c8b50c79aa6fbcda20aba9735c3076f"}
Aug 04 15:43:14.269306 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:14.268865    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb" event={"ID":"b77e12b3-4449-4ced-8a75-9d24a1bcb62e","Type":"ContainerStarted","Data":"2647f4cf1a06bb2da4762ac6aaa8cd69edd6ee54a54111b4bfe349bce34a2559"}
Aug 04 15:43:14.288153 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:14.288101    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb" podStartSLOduration=1.288084743 podStartE2EDuration="1.288084743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:43:14.286494594 +0000 UTC m=+2208.501507387" watchObservedRunningTime="2026-08-04 15:43:14.288084743 +0000 UTC m=+2208.503097538"
Aug 04 15:43:15.274724 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:15.274691    2581 generic.go:356] "Generic (PLEG): container finished" podID="b77e12b3-4449-4ced-8a75-9d24a1bcb62e" containerID="7cc0669ad75a4c18399a297f44ef869a2c8b50c79aa6fbcda20aba9735c3076f" exitCode=0
Aug 04 15:43:15.275127 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:15.274782    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb" event={"ID":"b77e12b3-4449-4ced-8a75-9d24a1bcb62e","Type":"ContainerDied","Data":"7cc0669ad75a4c18399a297f44ef869a2c8b50c79aa6fbcda20aba9735c3076f"}
Aug 04 15:43:16.404150 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:16.404117    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:16.523359 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:16.523314    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b77e12b3-4449-4ced-8a75-9d24a1bcb62e-maas-api-service-ca\") pod \"b77e12b3-4449-4ced-8a75-9d24a1bcb62e\" (UID: \"b77e12b3-4449-4ced-8a75-9d24a1bcb62e\") "
Aug 04 15:43:16.523733 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:16.523703    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77e12b3-4449-4ced-8a75-9d24a1bcb62e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b77e12b3-4449-4ced-8a75-9d24a1bcb62e" (UID: "b77e12b3-4449-4ced-8a75-9d24a1bcb62e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:43:16.624724 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:16.624645    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b77e12b3-4449-4ced-8a75-9d24a1bcb62e-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:43:17.284417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:17.284385    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"
Aug 04 15:43:17.284417 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:17.284393    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb" event={"ID":"b77e12b3-4449-4ced-8a75-9d24a1bcb62e","Type":"ContainerDied","Data":"2647f4cf1a06bb2da4762ac6aaa8cd69edd6ee54a54111b4bfe349bce34a2559"}
Aug 04 15:43:17.284656 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:17.284473    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2647f4cf1a06bb2da4762ac6aaa8cd69edd6ee54a54111b4bfe349bce34a2559"
Aug 04 15:43:23.975223 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:23.975185    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"]
Aug 04 15:43:23.983158 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:23.983132    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-96b2e1f8-b26vb"]
Aug 04 15:43:24.302051 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:43:24.301963    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77e12b3-4449-4ced-8a75-9d24a1bcb62e" path="/var/lib/kubelet/pods/b77e12b3-4449-4ced-8a75-9d24a1bcb62e/volumes"
Aug 04 15:44:12.589650 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:12.589612    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"]
Aug 04 15:44:12.592086 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:12.589818    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw" podUID="140bd659-7ef7-406b-ab99-176437d1ba17" containerName="manager" containerID="cri-o://27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d" gracePeriod=10
Aug 04 15:44:13.142938 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.142913    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:44:13.207510 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.207429    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/140bd659-7ef7-406b-ab99-176437d1ba17-extensions-socket-volume\") pod \"140bd659-7ef7-406b-ab99-176437d1ba17\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") "
Aug 04 15:44:13.207672 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.207562    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccdb\" (UniqueName: \"kubernetes.io/projected/140bd659-7ef7-406b-ab99-176437d1ba17-kube-api-access-mccdb\") pod \"140bd659-7ef7-406b-ab99-176437d1ba17\" (UID: \"140bd659-7ef7-406b-ab99-176437d1ba17\") "
Aug 04 15:44:13.207933 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.207905    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/140bd659-7ef7-406b-ab99-176437d1ba17-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "140bd659-7ef7-406b-ab99-176437d1ba17" (UID: "140bd659-7ef7-406b-ab99-176437d1ba17"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:44:13.209846 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.209825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/140bd659-7ef7-406b-ab99-176437d1ba17-kube-api-access-mccdb" (OuterVolumeSpecName: "kube-api-access-mccdb") pod "140bd659-7ef7-406b-ab99-176437d1ba17" (UID: "140bd659-7ef7-406b-ab99-176437d1ba17"). InnerVolumeSpecName "kube-api-access-mccdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:44:13.308901 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.308853    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccdb\" (UniqueName: \"kubernetes.io/projected/140bd659-7ef7-406b-ab99-176437d1ba17-kube-api-access-mccdb\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:44:13.308901 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.308889    2581 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/140bd659-7ef7-406b-ab99-176437d1ba17-extensions-socket-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:44:13.521875 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.521789    2581 generic.go:356] "Generic (PLEG): container finished" podID="140bd659-7ef7-406b-ab99-176437d1ba17" containerID="27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d" exitCode=0
Aug 04 15:44:13.521875 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.521834    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"
Aug 04 15:44:13.522109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.521875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw" event={"ID":"140bd659-7ef7-406b-ab99-176437d1ba17","Type":"ContainerDied","Data":"27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d"}
Aug 04 15:44:13.522109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.521930    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw" event={"ID":"140bd659-7ef7-406b-ab99-176437d1ba17","Type":"ContainerDied","Data":"3002f36db056d20270233caaa58b40d5616c8245c580c05e7d904023746423ae"}
Aug 04 15:44:13.522109 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.521958    2581 scope.go:117] "RemoveContainer" containerID="27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d"
Aug 04 15:44:13.531784 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.531763    2581 scope.go:117] "RemoveContainer" containerID="27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d"
Aug 04 15:44:13.532042 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:44:13.532024    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d\": container with ID starting with 27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d not found: ID does not exist" containerID="27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d"
Aug 04 15:44:13.532085 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.532049    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d"} err="failed to get container status \"27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d\": rpc error: code = NotFound desc = could not find container \"27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d\": container with ID starting with 27170b1b176848c7b2df553162de4ad927db0c20786f3d46e50f7eea1a2edb7d not found: ID does not exist"
Aug 04 15:44:13.545283 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.545257    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"]
Aug 04 15:44:13.550118 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:13.550098    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-722fw"]
Aug 04 15:44:14.301975 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:14.301937    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="140bd659-7ef7-406b-ab99-176437d1ba17" path="/var/lib/kubelet/pods/140bd659-7ef7-406b-ab99-176437d1ba17/volumes"
Aug 04 15:44:26.417290 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:44:26.417257    2581 scope.go:117] "RemoveContainer" containerID="1140c94d61a303595521c3ae307fa271fae469ab81df7172176898c0661ae1e4"
Aug 04 15:45:00.141280 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141243    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"]
Aug 04 15:45:00.141735 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141566    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77e12b3-4449-4ced-8a75-9d24a1bcb62e" containerName="revoke-keys"
Aug 04 15:45:00.141735 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141583    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77e12b3-4449-4ced-8a75-9d24a1bcb62e" containerName="revoke-keys"
Aug 04 15:45:00.141735 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141595    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="140bd659-7ef7-406b-ab99-176437d1ba17" containerName="manager"
Aug 04 15:45:00.141735 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141600    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="140bd659-7ef7-406b-ab99-176437d1ba17" containerName="manager"
Aug 04 15:45:00.141735 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141652    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77e12b3-4449-4ced-8a75-9d24a1bcb62e" containerName="revoke-keys"
Aug 04 15:45:00.141735 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.141663    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="140bd659-7ef7-406b-ab99-176437d1ba17" containerName="manager"
Aug 04 15:45:00.144650 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.144632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"
Aug 04 15:45:00.147765 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.147743    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:45:00.151157 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.151132    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"]
Aug 04 15:45:00.155145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.155123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"
Aug 04 15:45:00.284360 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.284256    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"]
Aug 04 15:45:00.287317 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:45:00.287288    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51ec576f_3c82_4602_b3b5_107060aa4a8d.slice/crio-15dbb79fafee684f5e8426e8dc1fba642216f0aa22ed6215a0f0df778b9b49ca WatchSource:0}: Error finding container 15dbb79fafee684f5e8426e8dc1fba642216f0aa22ed6215a0f0df778b9b49ca: Status 404 returned error can't find the container with id 15dbb79fafee684f5e8426e8dc1fba642216f0aa22ed6215a0f0df778b9b49ca
Aug 04 15:45:00.711361 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.711329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv" event={"ID":"51ec576f-3c82-4602-b3b5-107060aa4a8d","Type":"ContainerStarted","Data":"5df6cc7a04f68c30285550af04fb41869920ca7fb1e408d5824d33961c979504"}
Aug 04 15:45:00.711560 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.711384    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv" event={"ID":"51ec576f-3c82-4602-b3b5-107060aa4a8d","Type":"ContainerStarted","Data":"15dbb79fafee684f5e8426e8dc1fba642216f0aa22ed6215a0f0df778b9b49ca"}
Aug 04 15:45:00.728468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:00.728382    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv" podStartSLOduration=0.728368561 podStartE2EDuration="728.368561ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:45:00.727189188 +0000 UTC m=+2314.942201983" watchObservedRunningTime="2026-08-04 15:45:00.728368561 +0000 UTC m=+2314.943381356"
Aug 04 15:45:01.716806 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:01.716771    2581 generic.go:356] "Generic (PLEG): container finished" podID="51ec576f-3c82-4602-b3b5-107060aa4a8d" containerID="5df6cc7a04f68c30285550af04fb41869920ca7fb1e408d5824d33961c979504" exitCode=0
Aug 04 15:45:01.717199 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:01.716840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv" event={"ID":"51ec576f-3c82-4602-b3b5-107060aa4a8d","Type":"ContainerDied","Data":"5df6cc7a04f68c30285550af04fb41869920ca7fb1e408d5824d33961c979504"}
Aug 04 15:45:02.850312 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:02.850285    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"
Aug 04 15:45:03.726469 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:03.726437    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv"
Aug 04 15:45:03.726469 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:03.726464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764305-n6djv" event={"ID":"51ec576f-3c82-4602-b3b5-107060aa4a8d","Type":"ContainerDied","Data":"15dbb79fafee684f5e8426e8dc1fba642216f0aa22ed6215a0f0df778b9b49ca"}
Aug 04 15:45:03.726687 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:03.726505    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="15dbb79fafee684f5e8426e8dc1fba642216f0aa22ed6215a0f0df778b9b49ca"
Aug 04 15:45:26.437499 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:26.437427    2581 scope.go:117] "RemoveContainer" containerID="d6e0ceb6fb6aa40db898a6f48f5134e411763e7de20b6ececb1cb9228031ebc2"
Aug 04 15:45:28.244443 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.244405    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"]
Aug 04 15:45:28.244837 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.244777    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51ec576f-3c82-4602-b3b5-107060aa4a8d" containerName="cleanup"
Aug 04 15:45:28.244837 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.244792    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="51ec576f-3c82-4602-b3b5-107060aa4a8d" containerName="cleanup"
Aug 04 15:45:28.244906 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.244844    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="51ec576f-3c82-4602-b3b5-107060aa4a8d" containerName="cleanup"
Aug 04 15:45:28.248987 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.248969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.251923 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.251890    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fmv6n\""
Aug 04 15:45:28.252061 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.251929    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 15:45:28.252061 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.252026    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 15:45:28.263086 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.263047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"]
Aug 04 15:45:28.313202 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.313157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7556\" (UniqueName: \"kubernetes.io/projected/76735616-36c9-46d2-9733-d921b1d4cf57-kube-api-access-w7556\") pod \"kuadrant-operator-controller-manager-86878c769f-zsc6h\" (UID: \"76735616-36c9-46d2-9733-d921b1d4cf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.313202 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.313202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76735616-36c9-46d2-9733-d921b1d4cf57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zsc6h\" (UID: \"76735616-36c9-46d2-9733-d921b1d4cf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.414516 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.414469    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7556\" (UniqueName: \"kubernetes.io/projected/76735616-36c9-46d2-9733-d921b1d4cf57-kube-api-access-w7556\") pod \"kuadrant-operator-controller-manager-86878c769f-zsc6h\" (UID: \"76735616-36c9-46d2-9733-d921b1d4cf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.414677 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.414521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76735616-36c9-46d2-9733-d921b1d4cf57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zsc6h\" (UID: \"76735616-36c9-46d2-9733-d921b1d4cf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.414893 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.414875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76735616-36c9-46d2-9733-d921b1d4cf57-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zsc6h\" (UID: \"76735616-36c9-46d2-9733-d921b1d4cf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.424285 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.424256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7556\" (UniqueName: \"kubernetes.io/projected/76735616-36c9-46d2-9733-d921b1d4cf57-kube-api-access-w7556\") pod \"kuadrant-operator-controller-manager-86878c769f-zsc6h\" (UID: \"76735616-36c9-46d2-9733-d921b1d4cf57\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.559166 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.559080    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.708834 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.708799    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"]
Aug 04 15:45:28.712312 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:45:28.712284    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76735616_36c9_46d2_9733_d921b1d4cf57.slice/crio-b6f7b785d17d37df13607e3a533a5593b3a67c15a052aedf7da971e9ef601a0f WatchSource:0}: Error finding container b6f7b785d17d37df13607e3a533a5593b3a67c15a052aedf7da971e9ef601a0f: Status 404 returned error can't find the container with id b6f7b785d17d37df13607e3a533a5593b3a67c15a052aedf7da971e9ef601a0f
Aug 04 15:45:28.833058 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.832958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h" event={"ID":"76735616-36c9-46d2-9733-d921b1d4cf57","Type":"ContainerStarted","Data":"2c87a3b4d57814a10a437faaa2c381d2b89191ffae20e31844f122f2bd35d49f"}
Aug 04 15:45:28.833058 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.833022    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h" event={"ID":"76735616-36c9-46d2-9733-d921b1d4cf57","Type":"ContainerStarted","Data":"b6f7b785d17d37df13607e3a533a5593b3a67c15a052aedf7da971e9ef601a0f"}
Aug 04 15:45:28.833251 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.833062    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:45:28.857939 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:28.857878    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h" podStartSLOduration=0.857857647 podStartE2EDuration="857.857647ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:45:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:45:28.854784137 +0000 UTC m=+2343.069796933" watchObservedRunningTime="2026-08-04 15:45:28.857857647 +0000 UTC m=+2343.072870445"
Aug 04 15:45:39.839859 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:45:39.839826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zsc6h"
Aug 04 15:46:26.455156 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:46:26.455129    2581 scope.go:117] "RemoveContainer" containerID="727e06a905491989490cfa276e34d6a1de283919b38148db3b1454eb51d3aeb6"
Aug 04 15:46:26.462845 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:46:26.462827    2581 scope.go:117] "RemoveContainer" containerID="a84f410aea2eba7ca3f6f5cf45ba60d401e418ec21be590733f7346be5fa207f"
Aug 04 15:47:04.557730 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.557689    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"]
Aug 04 15:47:04.560706 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.560691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:04.563729 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.563710    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:47:04.563854 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.563742    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:47:04.574709 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.574685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"]
Aug 04 15:47:04.650571 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.650507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a394cd-be81-4616-bce9-3734cb31ba2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2\" (UID: \"07a394cd-be81-4616-bce9-3734cb31ba2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:04.751465 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.751428    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a394cd-be81-4616-bce9-3734cb31ba2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2\" (UID: \"07a394cd-be81-4616-bce9-3734cb31ba2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:04.752084 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.752053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a394cd-be81-4616-bce9-3734cb31ba2f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2\" (UID: \"07a394cd-be81-4616-bce9-3734cb31ba2f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:04.870269 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.870185    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:04.999365 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:04.999340    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"]
Aug 04 15:47:05.001916 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:47:05.001889    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a394cd_be81_4616_bce9_3734cb31ba2f.slice/crio-7813aa34c2ff2ed73de8ff4d1f2ae7ce156bd8dd1409131e69db5aedaaaf5d59 WatchSource:0}: Error finding container 7813aa34c2ff2ed73de8ff4d1f2ae7ce156bd8dd1409131e69db5aedaaaf5d59: Status 404 returned error can't find the container with id 7813aa34c2ff2ed73de8ff4d1f2ae7ce156bd8dd1409131e69db5aedaaaf5d59
Aug 04 15:47:05.249854 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:05.249820    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2" event={"ID":"07a394cd-be81-4616-bce9-3734cb31ba2f","Type":"ContainerStarted","Data":"bcfbcb50d121d8b7e988d21cc64b6d73df282ac7e31ce5a0e68113e5236f9bcd"}
Aug 04 15:47:05.250014 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:05.249878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2" event={"ID":"07a394cd-be81-4616-bce9-3734cb31ba2f","Type":"ContainerStarted","Data":"7813aa34c2ff2ed73de8ff4d1f2ae7ce156bd8dd1409131e69db5aedaaaf5d59"}
Aug 04 15:47:05.268027 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:05.267978    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2" podStartSLOduration=1.2679627039999999 podStartE2EDuration="1.267962704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:47:05.266680906 +0000 UTC m=+2439.481693702" watchObservedRunningTime="2026-08-04 15:47:05.267962704 +0000 UTC m=+2439.482975499"
Aug 04 15:47:06.256370 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:06.256338    2581 generic.go:356] "Generic (PLEG): container finished" podID="07a394cd-be81-4616-bce9-3734cb31ba2f" containerID="bcfbcb50d121d8b7e988d21cc64b6d73df282ac7e31ce5a0e68113e5236f9bcd" exitCode=0
Aug 04 15:47:06.256757 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:06.256412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2" event={"ID":"07a394cd-be81-4616-bce9-3734cb31ba2f","Type":"ContainerDied","Data":"bcfbcb50d121d8b7e988d21cc64b6d73df282ac7e31ce5a0e68113e5236f9bcd"}
Aug 04 15:47:07.385803 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:07.385774    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:07.473963 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:07.473926    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a394cd-be81-4616-bce9-3734cb31ba2f-maas-api-service-ca\") pod \"07a394cd-be81-4616-bce9-3734cb31ba2f\" (UID: \"07a394cd-be81-4616-bce9-3734cb31ba2f\") "
Aug 04 15:47:07.474308 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:07.474281    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a394cd-be81-4616-bce9-3734cb31ba2f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "07a394cd-be81-4616-bce9-3734cb31ba2f" (UID: "07a394cd-be81-4616-bce9-3734cb31ba2f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:47:07.575374 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:07.575278    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/07a394cd-be81-4616-bce9-3734cb31ba2f-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:47:08.266802 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:08.266761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2" event={"ID":"07a394cd-be81-4616-bce9-3734cb31ba2f","Type":"ContainerDied","Data":"7813aa34c2ff2ed73de8ff4d1f2ae7ce156bd8dd1409131e69db5aedaaaf5d59"}
Aug 04 15:47:08.266988 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:08.266858    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7813aa34c2ff2ed73de8ff4d1f2ae7ce156bd8dd1409131e69db5aedaaaf5d59"
Aug 04 15:47:08.266988 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:08.266778    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"
Aug 04 15:47:20.549256 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:20.549216    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"]
Aug 04 15:47:20.560948 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:20.560896    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-01d7a1ad-9xfg2"]
Aug 04 15:47:22.301843 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:47:22.301812    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a394cd-be81-4616-bce9-3734cb31ba2f" path="/var/lib/kubelet/pods/07a394cd-be81-4616-bce9-3734cb31ba2f/volumes"
Aug 04 15:49:26.495101 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:49:26.495062    2581 scope.go:117] "RemoveContainer" containerID="7cc0669ad75a4c18399a297f44ef869a2c8b50c79aa6fbcda20aba9735c3076f"
Aug 04 15:51:06.895566 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.895508    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"]
Aug 04 15:51:06.896024 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.895932    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a394cd-be81-4616-bce9-3734cb31ba2f" containerName="revoke-keys"
Aug 04 15:51:06.896024 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.895946    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a394cd-be81-4616-bce9-3734cb31ba2f" containerName="revoke-keys"
Aug 04 15:51:06.896024 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.896003    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a394cd-be81-4616-bce9-3734cb31ba2f" containerName="revoke-keys"
Aug 04 15:51:06.899054 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.899031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:06.901924 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.901903    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-926308\"/\"kube-root-ca.crt\""
Aug 04 15:51:06.903197 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.903175    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-926308\"/\"test-model-926308-kserve-self-signed-certs\""
Aug 04 15:51:06.903313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.903175    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-926308\"/\"openshift-service-ca.crt\""
Aug 04 15:51:06.903313 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.903278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-926308\"/\"default-dockercfg-tmfqr\""
Aug 04 15:51:06.914481 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.914433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"]
Aug 04 15:51:06.979038 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.979001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/759545ca-aa4d-4a64-a771-430a8630e367-tls-certs\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:06.979038 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.979040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-dshm\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:06.979283 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.979066    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-tmp-dir\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:06.979283 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.979150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-home\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:06.979283 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.979199    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cn4b\" (UniqueName: \"kubernetes.io/projected/759545ca-aa4d-4a64-a771-430a8630e367-kube-api-access-5cn4b\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:06.979283 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:06.979249    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-model-cache\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080392 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/759545ca-aa4d-4a64-a771-430a8630e367-tls-certs\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080392 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-dshm\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080661 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-tmp-dir\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080661 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-home\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080661 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cn4b\" (UniqueName: \"kubernetes.io/projected/759545ca-aa4d-4a64-a771-430a8630e367-kube-api-access-5cn4b\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080661 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080628    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-model-cache\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080855 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-home\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080855 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080843    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-tmp-dir\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.080989 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.080972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-model-cache\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.082859 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.082835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-dshm\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.083131 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.083112    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/759545ca-aa4d-4a64-a771-430a8630e367-tls-certs\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.091125 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.091105    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cn4b\" (UniqueName: \"kubernetes.io/projected/759545ca-aa4d-4a64-a771-430a8630e367-kube-api-access-5cn4b\") pod \"test-model-926308-kserve-696ff57dc7-vxdbf\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") " pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.209037 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.208945    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:07.346143 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:07.346112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"]
Aug 04 15:51:07.348604 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:51:07.348576    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod759545ca_aa4d_4a64_a771_430a8630e367.slice/crio-b1e43f8ef2183052bdc4ba18b38a643d4f0014a1e2b139a6a675f41b0692b52f WatchSource:0}: Error finding container b1e43f8ef2183052bdc4ba18b38a643d4f0014a1e2b139a6a675f41b0692b52f: Status 404 returned error can't find the container with id b1e43f8ef2183052bdc4ba18b38a643d4f0014a1e2b139a6a675f41b0692b52f
Aug 04 15:51:08.273424 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:08.273385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf" event={"ID":"759545ca-aa4d-4a64-a771-430a8630e367","Type":"ContainerStarted","Data":"bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26"}
Aug 04 15:51:08.273424 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:08.273425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf" event={"ID":"759545ca-aa4d-4a64-a771-430a8630e367","Type":"ContainerStarted","Data":"b1e43f8ef2183052bdc4ba18b38a643d4f0014a1e2b139a6a675f41b0692b52f"}
Aug 04 15:51:08.294150 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:08.294105    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf" podStartSLOduration=2.294089934 podStartE2EDuration="2.294089934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:51:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:51:08.292884623 +0000 UTC m=+2682.507897418" watchObservedRunningTime="2026-08-04 15:51:08.294089934 +0000 UTC m=+2682.509102729"
Aug 04 15:51:17.209994 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:17.209944    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:17.210380 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:17.210011    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:17.222520 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:17.222492    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:17.319259 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:17.319186    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:51:49.188383 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.188346    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"]
Aug 04 15:51:49.338610 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.338577    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"]
Aug 04 15:51:49.341918 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.341900    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:51:49.344805 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.344786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:51:49.344910 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.344788    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:51:49.351820 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.351798    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"]
Aug 04 15:51:49.447024 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.446931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w\" (UID: \"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:51:49.548494 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.548459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w\" (UID: \"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:51:49.549091 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.549070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w\" (UID: \"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:51:49.651802 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.651766    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:51:49.785440 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:49.785415    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"]
Aug 04 15:51:49.787471 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:51:49.787440    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66312a1d_c64b_4c5d_9bca_d2ce2426c8bf.slice/crio-b3814e9e421b7fd6c38ef46caf28ac433b0d6dfb03fa09d62ddcb6cf8751ad8c WatchSource:0}: Error finding container b3814e9e421b7fd6c38ef46caf28ac433b0d6dfb03fa09d62ddcb6cf8751ad8c: Status 404 returned error can't find the container with id b3814e9e421b7fd6c38ef46caf28ac433b0d6dfb03fa09d62ddcb6cf8751ad8c
Aug 04 15:51:50.442878 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:50.442843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w" event={"ID":"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf","Type":"ContainerStarted","Data":"1a8232477e29bf89c3cba225d4fdb1261c9fa385c20d0ca6a4ad3b75345bcc79"}
Aug 04 15:51:50.443284 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:50.442903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w" event={"ID":"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf","Type":"ContainerStarted","Data":"b3814e9e421b7fd6c38ef46caf28ac433b0d6dfb03fa09d62ddcb6cf8751ad8c"}
Aug 04 15:51:50.460153 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:50.460093    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w" podStartSLOduration=1.460069878 podStartE2EDuration="1.460069878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:51:50.458471296 +0000 UTC m=+2724.673484093" watchObservedRunningTime="2026-08-04 15:51:50.460069878 +0000 UTC m=+2724.675082677"
Aug 04 15:51:51.449756 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:51.449723    2581 generic.go:356] "Generic (PLEG): container finished" podID="66312a1d-c64b-4c5d-9bca-d2ce2426c8bf" containerID="1a8232477e29bf89c3cba225d4fdb1261c9fa385c20d0ca6a4ad3b75345bcc79" exitCode=0
Aug 04 15:51:51.450152 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:51.449815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w" event={"ID":"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf","Type":"ContainerDied","Data":"1a8232477e29bf89c3cba225d4fdb1261c9fa385c20d0ca6a4ad3b75345bcc79"}
Aug 04 15:51:52.584480 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:52.584447    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:51:52.677001 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:52.676958    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf-maas-api-service-ca\") pod \"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf\" (UID: \"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf\") "
Aug 04 15:51:52.677358 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:52.677332    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66312a1d-c64b-4c5d-9bca-d2ce2426c8bf" (UID: "66312a1d-c64b-4c5d-9bca-d2ce2426c8bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:51:52.778669 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:52.778585    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:51:53.460305 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:53.460262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w" event={"ID":"66312a1d-c64b-4c5d-9bca-d2ce2426c8bf","Type":"ContainerDied","Data":"b3814e9e421b7fd6c38ef46caf28ac433b0d6dfb03fa09d62ddcb6cf8751ad8c"}
Aug 04 15:51:53.460581 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:53.460318    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3814e9e421b7fd6c38ef46caf28ac433b0d6dfb03fa09d62ddcb6cf8751ad8c"
Aug 04 15:51:53.460581 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:51:53.460279    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"
Aug 04 15:52:00.184555 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:00.184204    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"]
Aug 04 15:52:00.187500 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:00.187468    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c2a99b-q559w"]
Aug 04 15:52:00.304154 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:00.304119    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66312a1d-c64b-4c5d-9bca-d2ce2426c8bf" path="/var/lib/kubelet/pods/66312a1d-c64b-4c5d-9bca-d2ce2426c8bf/volumes"
Aug 04 15:52:04.207626 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.207584    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf" podUID="759545ca-aa4d-4a64-a771-430a8630e367" containerName="main" containerID="cri-o://bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26" gracePeriod=45
Aug 04 15:52:04.457924 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.457859    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:52:04.475207 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-tmp-dir\") pod \"759545ca-aa4d-4a64-a771-430a8630e367\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") "
Aug 04 15:52:04.475367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475229    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cn4b\" (UniqueName: \"kubernetes.io/projected/759545ca-aa4d-4a64-a771-430a8630e367-kube-api-access-5cn4b\") pod \"759545ca-aa4d-4a64-a771-430a8630e367\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") "
Aug 04 15:52:04.475367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475261    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-dshm\") pod \"759545ca-aa4d-4a64-a771-430a8630e367\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") "
Aug 04 15:52:04.475367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475284    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/759545ca-aa4d-4a64-a771-430a8630e367-tls-certs\") pod \"759545ca-aa4d-4a64-a771-430a8630e367\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") "
Aug 04 15:52:04.475367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-home\") pod \"759545ca-aa4d-4a64-a771-430a8630e367\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") "
Aug 04 15:52:04.475367 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-model-cache\") pod \"759545ca-aa4d-4a64-a771-430a8630e367\" (UID: \"759545ca-aa4d-4a64-a771-430a8630e367\") "
Aug 04 15:52:04.475607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "759545ca-aa4d-4a64-a771-430a8630e367" (UID: "759545ca-aa4d-4a64-a771-430a8630e367"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:52:04.475607 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-home" (OuterVolumeSpecName: "home") pod "759545ca-aa4d-4a64-a771-430a8630e367" (UID: "759545ca-aa4d-4a64-a771-430a8630e367"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:52:04.475798 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475629    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-home\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:04.475798 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475649    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-tmp-dir\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:04.475798 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.475755    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-model-cache" (OuterVolumeSpecName: "model-cache") pod "759545ca-aa4d-4a64-a771-430a8630e367" (UID: "759545ca-aa4d-4a64-a771-430a8630e367"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:52:04.477952 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.477915    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/759545ca-aa4d-4a64-a771-430a8630e367-kube-api-access-5cn4b" (OuterVolumeSpecName: "kube-api-access-5cn4b") pod "759545ca-aa4d-4a64-a771-430a8630e367" (UID: "759545ca-aa4d-4a64-a771-430a8630e367"). InnerVolumeSpecName "kube-api-access-5cn4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:04.478720 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.478614    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/759545ca-aa4d-4a64-a771-430a8630e367-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "759545ca-aa4d-4a64-a771-430a8630e367" (UID: "759545ca-aa4d-4a64-a771-430a8630e367"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:52:04.478720 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.478698    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-dshm" (OuterVolumeSpecName: "dshm") pod "759545ca-aa4d-4a64-a771-430a8630e367" (UID: "759545ca-aa4d-4a64-a771-430a8630e367"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:52:04.508851 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.508819    2581 generic.go:356] "Generic (PLEG): container finished" podID="759545ca-aa4d-4a64-a771-430a8630e367" containerID="bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26" exitCode=0
Aug 04 15:52:04.509017 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.508859    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"
Aug 04 15:52:04.509017 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.508895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf" event={"ID":"759545ca-aa4d-4a64-a771-430a8630e367","Type":"ContainerDied","Data":"bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26"}
Aug 04 15:52:04.509017 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.508934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf" event={"ID":"759545ca-aa4d-4a64-a771-430a8630e367","Type":"ContainerDied","Data":"b1e43f8ef2183052bdc4ba18b38a643d4f0014a1e2b139a6a675f41b0692b52f"}
Aug 04 15:52:04.509017 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.508958    2581 scope.go:117] "RemoveContainer" containerID="bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26"
Aug 04 15:52:04.517866 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.517849    2581 scope.go:117] "RemoveContainer" containerID="bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26"
Aug 04 15:52:04.518106 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:52:04.518086    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26\": container with ID starting with bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26 not found: ID does not exist" containerID="bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26"
Aug 04 15:52:04.518153 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.518116    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26"} err="failed to get container status \"bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26\": rpc error: code = NotFound desc = could not find container \"bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26\": container with ID starting with bd0182fc86696982be9b0cc15a21f3eb7d0ffcc62ece4f6eedd41307729b2d26 not found: ID does not exist"
Aug 04 15:52:04.532841 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.532820    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"]
Aug 04 15:52:04.535260 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.535241    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-926308/test-model-926308-kserve-696ff57dc7-vxdbf"]
Aug 04 15:52:04.576396 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.576350    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-dshm\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:04.576396 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.576393    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/759545ca-aa4d-4a64-a771-430a8630e367-tls-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:04.576396 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.576408    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/759545ca-aa4d-4a64-a771-430a8630e367-model-cache\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:04.576701 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:04.576421    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cn4b\" (UniqueName: \"kubernetes.io/projected/759545ca-aa4d-4a64-a771-430a8630e367-kube-api-access-5cn4b\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:06.301223 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:06.301196    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="759545ca-aa4d-4a64-a771-430a8630e367" path="/var/lib/kubelet/pods/759545ca-aa4d-4a64-a771-430a8630e367/volumes"
Aug 04 15:52:07.400910 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.400869    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"]
Aug 04 15:52:07.401611 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.401588    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="759545ca-aa4d-4a64-a771-430a8630e367" containerName="main"
Aug 04 15:52:07.401611 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.401613    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="759545ca-aa4d-4a64-a771-430a8630e367" containerName="main"
Aug 04 15:52:07.401758 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.401628    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66312a1d-c64b-4c5d-9bca-d2ce2426c8bf" containerName="revoke-keys"
Aug 04 15:52:07.401758 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.401637    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="66312a1d-c64b-4c5d-9bca-d2ce2426c8bf" containerName="revoke-keys"
Aug 04 15:52:07.401845 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.401778    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="759545ca-aa4d-4a64-a771-430a8630e367" containerName="main"
Aug 04 15:52:07.401845 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.401796    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="66312a1d-c64b-4c5d-9bca-d2ce2426c8bf" containerName="revoke-keys"
Aug 04 15:52:07.406907 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.406884    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:07.410631 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.410613    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:52:07.411107 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.411093    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:52:07.415211 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.415188    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"]
Aug 04 15:52:07.501209 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.501176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99d09b-47c3-4078-bad3-9df6cc5a1b5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-926308-6hcpf\" (UID: \"db99d09b-47c3-4078-bad3-9df6cc5a1b5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:07.602165 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.602132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99d09b-47c3-4078-bad3-9df6cc5a1b5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-926308-6hcpf\" (UID: \"db99d09b-47c3-4078-bad3-9df6cc5a1b5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:07.602797 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.602775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99d09b-47c3-4078-bad3-9df6cc5a1b5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-926308-6hcpf\" (UID: \"db99d09b-47c3-4078-bad3-9df6cc5a1b5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:07.718030 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.717947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:07.854687 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:07.854657    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"]
Aug 04 15:52:07.859046 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:52:07.859020    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb99d09b_47c3_4078_bad3_9df6cc5a1b5c.slice/crio-6fa6479ff6a4e13cafe05c85a260c819bf7b11d4ffd2c860a114bf0b570e7268 WatchSource:0}: Error finding container 6fa6479ff6a4e13cafe05c85a260c819bf7b11d4ffd2c860a114bf0b570e7268: Status 404 returned error can't find the container with id 6fa6479ff6a4e13cafe05c85a260c819bf7b11d4ffd2c860a114bf0b570e7268
Aug 04 15:52:08.528031 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:08.527992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf" event={"ID":"db99d09b-47c3-4078-bad3-9df6cc5a1b5c","Type":"ContainerStarted","Data":"ef9621e72942a0ccd6789a7e558ed86d7efae3473db43edf750c6aa85e46500c"}
Aug 04 15:52:08.528425 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:08.528052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf" event={"ID":"db99d09b-47c3-4078-bad3-9df6cc5a1b5c","Type":"ContainerStarted","Data":"6fa6479ff6a4e13cafe05c85a260c819bf7b11d4ffd2c860a114bf0b570e7268"}
Aug 04 15:52:08.544665 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:08.544600    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf" podStartSLOduration=1.544584685 podStartE2EDuration="1.544584685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:52:08.543491295 +0000 UTC m=+2742.758504282" watchObservedRunningTime="2026-08-04 15:52:08.544584685 +0000 UTC m=+2742.759597481"
Aug 04 15:52:09.535060 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:09.535027    2581 generic.go:356] "Generic (PLEG): container finished" podID="db99d09b-47c3-4078-bad3-9df6cc5a1b5c" containerID="ef9621e72942a0ccd6789a7e558ed86d7efae3473db43edf750c6aa85e46500c" exitCode=0
Aug 04 15:52:09.535448 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:09.535124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf" event={"ID":"db99d09b-47c3-4078-bad3-9df6cc5a1b5c","Type":"ContainerDied","Data":"ef9621e72942a0ccd6789a7e558ed86d7efae3473db43edf750c6aa85e46500c"}
Aug 04 15:52:10.663490 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:10.663468    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:10.729823 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:10.729797    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99d09b-47c3-4078-bad3-9df6cc5a1b5c-maas-api-service-ca\") pod \"db99d09b-47c3-4078-bad3-9df6cc5a1b5c\" (UID: \"db99d09b-47c3-4078-bad3-9df6cc5a1b5c\") "
Aug 04 15:52:10.730101 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:10.730079    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db99d09b-47c3-4078-bad3-9df6cc5a1b5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "db99d09b-47c3-4078-bad3-9df6cc5a1b5c" (UID: "db99d09b-47c3-4078-bad3-9df6cc5a1b5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:10.831500 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:10.831404    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/db99d09b-47c3-4078-bad3-9df6cc5a1b5c-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:52:11.544798 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:11.544766    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"
Aug 04 15:52:11.544798 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:11.544788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf" event={"ID":"db99d09b-47c3-4078-bad3-9df6cc5a1b5c","Type":"ContainerDied","Data":"6fa6479ff6a4e13cafe05c85a260c819bf7b11d4ffd2c860a114bf0b570e7268"}
Aug 04 15:52:11.545058 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:11.544833    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fa6479ff6a4e13cafe05c85a260c819bf7b11d4ffd2c860a114bf0b570e7268"
Aug 04 15:52:18.202781 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:18.202742    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"]
Aug 04 15:52:18.206415 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:18.206374    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-926308-6hcpf"]
Aug 04 15:52:18.302293 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:52:18.302260    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db99d09b-47c3-4078-bad3-9df6cc5a1b5c" path="/var/lib/kubelet/pods/db99d09b-47c3-4078-bad3-9df6cc5a1b5c/volumes"
Aug 04 15:53:26.281674 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.281634    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"]
Aug 04 15:53:26.282146 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.281945    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db99d09b-47c3-4078-bad3-9df6cc5a1b5c" containerName="revoke-keys"
Aug 04 15:53:26.282146 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.281956    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="db99d09b-47c3-4078-bad3-9df6cc5a1b5c" containerName="revoke-keys"
Aug 04 15:53:26.282146 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.282020    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="db99d09b-47c3-4078-bad3-9df6cc5a1b5c" containerName="revoke-keys"
Aug 04 15:53:26.284827 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.284809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:26.287579 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.287560    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:53:26.287684 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.287566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:53:26.292524 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.292500    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"]
Aug 04 15:53:26.348842 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.348804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92e8206-7734-436b-8405-bd9ac3dd656a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr\" (UID: \"f92e8206-7734-436b-8405-bd9ac3dd656a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:26.450260 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.450218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92e8206-7734-436b-8405-bd9ac3dd656a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr\" (UID: \"f92e8206-7734-436b-8405-bd9ac3dd656a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:26.450979 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.450957    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92e8206-7734-436b-8405-bd9ac3dd656a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr\" (UID: \"f92e8206-7734-436b-8405-bd9ac3dd656a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:26.534342 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.534259    2581 scope.go:117] "RemoveContainer" containerID="bcfbcb50d121d8b7e988d21cc64b6d73df282ac7e31ce5a0e68113e5236f9bcd"
Aug 04 15:53:26.596378 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.596345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:26.764734 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.764704    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"]
Aug 04 15:53:26.767157 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:53:26.767128    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92e8206_7734_436b_8405_bd9ac3dd656a.slice/crio-b2706eafbedcb8535bc0c1edf8c250328fec6c9be583d7ef7d28640811f6583a WatchSource:0}: Error finding container b2706eafbedcb8535bc0c1edf8c250328fec6c9be583d7ef7d28640811f6583a: Status 404 returned error can't find the container with id b2706eafbedcb8535bc0c1edf8c250328fec6c9be583d7ef7d28640811f6583a
Aug 04 15:53:26.867705 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:26.867672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr" event={"ID":"f92e8206-7734-436b-8405-bd9ac3dd656a","Type":"ContainerStarted","Data":"b2706eafbedcb8535bc0c1edf8c250328fec6c9be583d7ef7d28640811f6583a"}
Aug 04 15:53:27.873145 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:27.873055    2581 generic.go:356] "Generic (PLEG): container finished" podID="f92e8206-7734-436b-8405-bd9ac3dd656a" containerID="8350c7463747c99bcfa8e0f9023ee8300221ab6372f45a4d1ab1fb29f02a665d" exitCode=0
Aug 04 15:53:27.873506 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:27.873143    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr" event={"ID":"f92e8206-7734-436b-8405-bd9ac3dd656a","Type":"ContainerDied","Data":"8350c7463747c99bcfa8e0f9023ee8300221ab6372f45a4d1ab1fb29f02a665d"}
Aug 04 15:53:29.010797 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.010762    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:29.071002 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.070962    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92e8206-7734-436b-8405-bd9ac3dd656a-maas-api-service-ca\") pod \"f92e8206-7734-436b-8405-bd9ac3dd656a\" (UID: \"f92e8206-7734-436b-8405-bd9ac3dd656a\") "
Aug 04 15:53:29.071354 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.071329    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f92e8206-7734-436b-8405-bd9ac3dd656a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f92e8206-7734-436b-8405-bd9ac3dd656a" (UID: "f92e8206-7734-436b-8405-bd9ac3dd656a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:53:29.172384 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.172349    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f92e8206-7734-436b-8405-bd9ac3dd656a-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:53:29.883593 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.883564    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"
Aug 04 15:53:29.883770 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.883560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr" event={"ID":"f92e8206-7734-436b-8405-bd9ac3dd656a","Type":"ContainerDied","Data":"b2706eafbedcb8535bc0c1edf8c250328fec6c9be583d7ef7d28640811f6583a"}
Aug 04 15:53:29.883770 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:29.883686    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b2706eafbedcb8535bc0c1edf8c250328fec6c9be583d7ef7d28640811f6583a"
Aug 04 15:53:42.091175 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:42.091129    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"]
Aug 04 15:53:42.093755 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:42.093717    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bac88d-tsrjr"]
Aug 04 15:53:42.303476 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:42.303446    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f92e8206-7734-436b-8405-bd9ac3dd656a" path="/var/lib/kubelet/pods/f92e8206-7734-436b-8405-bd9ac3dd656a/volumes"
Aug 04 15:53:49.174932 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.174891    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"]
Aug 04 15:53:49.175298 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.175221    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f92e8206-7734-436b-8405-bd9ac3dd656a" containerName="revoke-keys"
Aug 04 15:53:49.175298 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.175231    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f92e8206-7734-436b-8405-bd9ac3dd656a" containerName="revoke-keys"
Aug 04 15:53:49.175298 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.175292    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f92e8206-7734-436b-8405-bd9ac3dd656a" containerName="revoke-keys"
Aug 04 15:53:49.178356 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.178333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:53:49.181308 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.181282    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:53:49.181461 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.181317    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:53:49.187097 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.187071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"]
Aug 04 15:53:49.346694 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.346647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3663e022-4ea7-443e-a5b4-be3d844ef11c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-df124e-6gjxf\" (UID: \"3663e022-4ea7-443e-a5b4-be3d844ef11c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:53:49.447779 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.447677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3663e022-4ea7-443e-a5b4-be3d844ef11c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-df124e-6gjxf\" (UID: \"3663e022-4ea7-443e-a5b4-be3d844ef11c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:53:49.448486 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.448460    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3663e022-4ea7-443e-a5b4-be3d844ef11c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-df124e-6gjxf\" (UID: \"3663e022-4ea7-443e-a5b4-be3d844ef11c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:53:49.490223 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.490176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:53:49.628739 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.628602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"]
Aug 04 15:53:49.631681 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:53:49.631644    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3663e022_4ea7_443e_a5b4_be3d844ef11c.slice/crio-78c6a93da171d02863f3506c462668f786a9588e74e488fb71cbc5fb5c70065f WatchSource:0}: Error finding container 78c6a93da171d02863f3506c462668f786a9588e74e488fb71cbc5fb5c70065f: Status 404 returned error can't find the container with id 78c6a93da171d02863f3506c462668f786a9588e74e488fb71cbc5fb5c70065f
Aug 04 15:53:49.970479 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.970446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf" event={"ID":"3663e022-4ea7-443e-a5b4-be3d844ef11c","Type":"ContainerStarted","Data":"c375ba595be7f623f0563155924d142c4898c9ade7f0db564892452ddfafad7b"}
Aug 04 15:53:49.970644 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.970510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf" event={"ID":"3663e022-4ea7-443e-a5b4-be3d844ef11c","Type":"ContainerStarted","Data":"78c6a93da171d02863f3506c462668f786a9588e74e488fb71cbc5fb5c70065f"}
Aug 04 15:53:49.989468 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:49.989412    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf" podStartSLOduration=0.98939378 podStartE2EDuration="989.39378ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:53:49.987516551 +0000 UTC m=+2844.202529357" watchObservedRunningTime="2026-08-04 15:53:49.98939378 +0000 UTC m=+2844.204406577"
Aug 04 15:53:50.976025 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:50.975994    2581 generic.go:356] "Generic (PLEG): container finished" podID="3663e022-4ea7-443e-a5b4-be3d844ef11c" containerID="c375ba595be7f623f0563155924d142c4898c9ade7f0db564892452ddfafad7b" exitCode=0
Aug 04 15:53:50.976411 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:50.976031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf" event={"ID":"3663e022-4ea7-443e-a5b4-be3d844ef11c","Type":"ContainerDied","Data":"c375ba595be7f623f0563155924d142c4898c9ade7f0db564892452ddfafad7b"}
Aug 04 15:53:52.108066 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.108038    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:53:52.274703 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.274604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3663e022-4ea7-443e-a5b4-be3d844ef11c-maas-api-service-ca\") pod \"3663e022-4ea7-443e-a5b4-be3d844ef11c\" (UID: \"3663e022-4ea7-443e-a5b4-be3d844ef11c\") "
Aug 04 15:53:52.274936 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.274913    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3663e022-4ea7-443e-a5b4-be3d844ef11c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3663e022-4ea7-443e-a5b4-be3d844ef11c" (UID: "3663e022-4ea7-443e-a5b4-be3d844ef11c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:53:52.375523 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.375481    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3663e022-4ea7-443e-a5b4-be3d844ef11c-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:53:52.991586 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.991510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf" event={"ID":"3663e022-4ea7-443e-a5b4-be3d844ef11c","Type":"ContainerDied","Data":"78c6a93da171d02863f3506c462668f786a9588e74e488fb71cbc5fb5c70065f"}
Aug 04 15:53:52.991776 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.991630    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78c6a93da171d02863f3506c462668f786a9588e74e488fb71cbc5fb5c70065f"
Aug 04 15:53:52.991776 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:53:52.991566    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"
Aug 04 15:54:04.867890 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:54:04.867850    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"]
Aug 04 15:54:04.870717 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:54:04.870691    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-df124e-6gjxf"]
Aug 04 15:54:06.302108 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:54:06.302074    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3663e022-4ea7-443e-a5b4-be3d844ef11c" path="/var/lib/kubelet/pods/3663e022-4ea7-443e-a5b4-be3d844ef11c/volumes"
Aug 04 15:55:43.198074 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.198034    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"]
Aug 04 15:55:43.198632 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.198337    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3663e022-4ea7-443e-a5b4-be3d844ef11c" containerName="revoke-keys"
Aug 04 15:55:43.198632 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.198349    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3663e022-4ea7-443e-a5b4-be3d844ef11c" containerName="revoke-keys"
Aug 04 15:55:43.198632 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.198441    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3663e022-4ea7-443e-a5b4-be3d844ef11c" containerName="revoke-keys"
Aug 04 15:55:43.201237 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.201220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.205403 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.205380    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"default-dockercfg-6xmxr\""
Aug 04 15:55:43.205554 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.205416    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"openshift-service-ca.crt\""
Aug 04 15:55:43.205554 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.205419    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"auth-test-model-7b41f3-kserve-self-signed-certs\""
Aug 04 15:55:43.205740 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.205680    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"kube-root-ca.crt\""
Aug 04 15:55:43.210904 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.210885    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"]
Aug 04 15:55:43.287990 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.287959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/864609e7-9c12-4011-9b5f-51f759ccdf0b-tls-certs\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.287990 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.288000    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-home\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.288231 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.288033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-dshm\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.288231 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.288117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-model-cache\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.288231 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.288153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-tmp-dir\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.288231 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.288189    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh2vj\" (UniqueName: \"kubernetes.io/projected/864609e7-9c12-4011-9b5f-51f759ccdf0b-kube-api-access-bh2vj\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.388679 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.388635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh2vj\" (UniqueName: \"kubernetes.io/projected/864609e7-9c12-4011-9b5f-51f759ccdf0b-kube-api-access-bh2vj\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.388895 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.388693    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/864609e7-9c12-4011-9b5f-51f759ccdf0b-tls-certs\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.388895 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.388739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-home\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.388895 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.388773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-dshm\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.388895 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.388800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-model-cache\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.388895 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.388819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-tmp-dir\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.389171 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.389150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-home\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.389240 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.389219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-tmp-dir\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.389280 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.389248    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-model-cache\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.391266 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.391244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-dshm\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.391581 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.391558    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/864609e7-9c12-4011-9b5f-51f759ccdf0b-tls-certs\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.399238 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.399210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh2vj\" (UniqueName: \"kubernetes.io/projected/864609e7-9c12-4011-9b5f-51f759ccdf0b-kube-api-access-bh2vj\") pod \"auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") " pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.511267 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.511176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:43.647331 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:43.647297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"]
Aug 04 15:55:43.650293 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:55:43.650266    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod864609e7_9c12_4011_9b5f_51f759ccdf0b.slice/crio-12ac9d167fb3587a5b293c501f4c9495f57ed0a384d6fa38d0e651b2a7544993 WatchSource:0}: Error finding container 12ac9d167fb3587a5b293c501f4c9495f57ed0a384d6fa38d0e651b2a7544993: Status 404 returned error can't find the container with id 12ac9d167fb3587a5b293c501f4c9495f57ed0a384d6fa38d0e651b2a7544993
Aug 04 15:55:44.480810 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:44.480763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp" event={"ID":"864609e7-9c12-4011-9b5f-51f759ccdf0b","Type":"ContainerStarted","Data":"fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777"}
Aug 04 15:55:44.480810 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:44.480808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp" event={"ID":"864609e7-9c12-4011-9b5f-51f759ccdf0b","Type":"ContainerStarted","Data":"12ac9d167fb3587a5b293c501f4c9495f57ed0a384d6fa38d0e651b2a7544993"}
Aug 04 15:55:44.500225 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:44.500176    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp" podStartSLOduration=1.500156866 podStartE2EDuration="1.500156866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:55:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:55:44.499672408 +0000 UTC m=+2958.714685207" watchObservedRunningTime="2026-08-04 15:55:44.500156866 +0000 UTC m=+2958.715169662"
Aug 04 15:55:53.511506 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:53.511460    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:53.512031 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:53.511641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:53.524504 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:53.524479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:55:54.538362 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:55:54.538330    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 15:58:26.579067 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:26.579035    2581 scope.go:117] "RemoveContainer" containerID="1a8232477e29bf89c3cba225d4fdb1261c9fa385c20d0ca6a4ad3b75345bcc79"
Aug 04 15:58:26.587199 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:26.587178    2581 scope.go:117] "RemoveContainer" containerID="ef9621e72942a0ccd6789a7e558ed86d7efae3473db43edf750c6aa85e46500c"
Aug 04 15:58:51.683164 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.683079    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xm5jm"]
Aug 04 15:58:51.686270 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.686253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:58:51.689059 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.689036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-lw5gj\""
Aug 04 15:58:51.701831 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.701789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtptx\" (UniqueName: \"kubernetes.io/projected/d7919dc9-d5d7-47c9-8746-0bc11fe5deda-kube-api-access-rtptx\") pod \"kuadrant-operator-catalog-xm5jm\" (UID: \"d7919dc9-d5d7-47c9-8746-0bc11fe5deda\") " pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:58:51.703790 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.703761    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xm5jm"]
Aug 04 15:58:51.803232 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.803197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtptx\" (UniqueName: \"kubernetes.io/projected/d7919dc9-d5d7-47c9-8746-0bc11fe5deda-kube-api-access-rtptx\") pod \"kuadrant-operator-catalog-xm5jm\" (UID: \"d7919dc9-d5d7-47c9-8746-0bc11fe5deda\") " pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:58:51.812901 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.812866    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtptx\" (UniqueName: \"kubernetes.io/projected/d7919dc9-d5d7-47c9-8746-0bc11fe5deda-kube-api-access-rtptx\") pod \"kuadrant-operator-catalog-xm5jm\" (UID: \"d7919dc9-d5d7-47c9-8746-0bc11fe5deda\") " pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:58:51.995519 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:51.995418    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:58:52.139148 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:52.139112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xm5jm"]
Aug 04 15:58:52.142269 ip-10-0-137-247 kubenswrapper[2581]: W0804 15:58:52.142237    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7919dc9_d5d7_47c9_8746_0bc11fe5deda.slice/crio-bb30a6ea7c368bffdb69ecc803752fc348c420d31c7c7d36e42eeeced2d40594 WatchSource:0}: Error finding container bb30a6ea7c368bffdb69ecc803752fc348c420d31c7c7d36e42eeeced2d40594: Status 404 returned error can't find the container with id bb30a6ea7c368bffdb69ecc803752fc348c420d31c7c7d36e42eeeced2d40594
Aug 04 15:58:52.143678 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:52.143655    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:58:52.293970 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:52.293874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm" event={"ID":"d7919dc9-d5d7-47c9-8746-0bc11fe5deda","Type":"ContainerStarted","Data":"bb30a6ea7c368bffdb69ecc803752fc348c420d31c7c7d36e42eeeced2d40594"}
Aug 04 15:58:54.308686 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:54.308651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm" event={"ID":"d7919dc9-d5d7-47c9-8746-0bc11fe5deda","Type":"ContainerStarted","Data":"2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917"}
Aug 04 15:58:54.328137 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:58:54.328045    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm" podStartSLOduration=1.393351251 podStartE2EDuration="3.328024726s" totalImagesPullingTime="1.934673475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:58:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:58:54.32674977 +0000 UTC m=+3148.541762566" watchObservedRunningTime="2026-08-04 15:58:54.328024726 +0000 UTC m=+3148.543037523"
Aug 04 15:59:01.995689 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:01.995592    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:59:01.995689 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:01.995689    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:59:02.018332 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:02.018300    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:59:02.363980 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:02.363898    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:59:02.403656 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:02.403625    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xm5jm"]
Aug 04 15:59:04.351125 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:04.351082    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm" podUID="d7919dc9-d5d7-47c9-8746-0bc11fe5deda" containerName="registry-server" containerID="cri-o://2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917" gracePeriod=2
Aug 04 15:59:04.604471 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:04.604411    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:59:04.711392 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:04.711352    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtptx\" (UniqueName: \"kubernetes.io/projected/d7919dc9-d5d7-47c9-8746-0bc11fe5deda-kube-api-access-rtptx\") pod \"d7919dc9-d5d7-47c9-8746-0bc11fe5deda\" (UID: \"d7919dc9-d5d7-47c9-8746-0bc11fe5deda\") "
Aug 04 15:59:04.713647 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:04.713616    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7919dc9-d5d7-47c9-8746-0bc11fe5deda-kube-api-access-rtptx" (OuterVolumeSpecName: "kube-api-access-rtptx") pod "d7919dc9-d5d7-47c9-8746-0bc11fe5deda" (UID: "d7919dc9-d5d7-47c9-8746-0bc11fe5deda"). InnerVolumeSpecName "kube-api-access-rtptx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:59:04.812865 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:04.812823    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtptx\" (UniqueName: \"kubernetes.io/projected/d7919dc9-d5d7-47c9-8746-0bc11fe5deda-kube-api-access-rtptx\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 15:59:05.357701 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.357666    2581 generic.go:356] "Generic (PLEG): container finished" podID="d7919dc9-d5d7-47c9-8746-0bc11fe5deda" containerID="2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917" exitCode=0
Aug 04 15:59:05.358144 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.357717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm" event={"ID":"d7919dc9-d5d7-47c9-8746-0bc11fe5deda","Type":"ContainerDied","Data":"2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917"}
Aug 04 15:59:05.358144 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.357771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm" event={"ID":"d7919dc9-d5d7-47c9-8746-0bc11fe5deda","Type":"ContainerDied","Data":"bb30a6ea7c368bffdb69ecc803752fc348c420d31c7c7d36e42eeeced2d40594"}
Aug 04 15:59:05.358144 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.357800    2581 scope.go:117] "RemoveContainer" containerID="2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917"
Aug 04 15:59:05.358144 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.357719    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xm5jm"
Aug 04 15:59:05.367956 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.367935    2581 scope.go:117] "RemoveContainer" containerID="2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917"
Aug 04 15:59:05.368273 ip-10-0-137-247 kubenswrapper[2581]: E0804 15:59:05.368254    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917\": container with ID starting with 2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917 not found: ID does not exist" containerID="2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917"
Aug 04 15:59:05.368325 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.368284    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917"} err="failed to get container status \"2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917\": rpc error: code = NotFound desc = could not find container \"2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917\": container with ID starting with 2bf3f442cd1d76432bb01d3a7e68c967de0a2799221c8b82e54ab9fd09d78917 not found: ID does not exist"
Aug 04 15:59:05.380566 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.380510    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xm5jm"]
Aug 04 15:59:05.386084 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:05.386051    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xm5jm"]
Aug 04 15:59:06.302153 ip-10-0-137-247 kubenswrapper[2581]: I0804 15:59:06.302118    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7919dc9-d5d7-47c9-8746-0bc11fe5deda" path="/var/lib/kubelet/pods/d7919dc9-d5d7-47c9-8746-0bc11fe5deda/volumes"
Aug 04 16:00:00.154381 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.154349    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"]
Aug 04 16:00:00.157009 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.154665    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7919dc9-d5d7-47c9-8746-0bc11fe5deda" containerName="registry-server"
Aug 04 16:00:00.157009 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.154676    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7919dc9-d5d7-47c9-8746-0bc11fe5deda" containerName="registry-server"
Aug 04 16:00:00.157009 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.154738    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7919dc9-d5d7-47c9-8746-0bc11fe5deda" containerName="registry-server"
Aug 04 16:00:00.157870 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.157852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"
Aug 04 16:00:00.161551 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.161511    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 16:00:00.162400 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.162378    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"]
Aug 04 16:00:00.165461 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.165444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"
Aug 04 16:00:00.167753 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.167736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"
Aug 04 16:00:00.176633 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.176609    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"]
Aug 04 16:00:00.177639 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.177619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"
Aug 04 16:00:00.195243 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.195197    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"]
Aug 04 16:00:00.199835 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.199209    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"
Aug 04 16:00:00.206790 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.206714    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"]
Aug 04 16:00:00.215760 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.215264    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"]
Aug 04 16:00:00.229610 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.229584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"
Aug 04 16:00:00.366994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.366966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"]
Aug 04 16:00:00.370964 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:00:00.370921    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod457e6773_2cbb_4c37_b3da_02f668882d84.slice/crio-0bee929e0840b2288d4fd4115f043953aa07afa621d6e24e754352021c2a8399 WatchSource:0}: Error finding container 0bee929e0840b2288d4fd4115f043953aa07afa621d6e24e754352021c2a8399: Status 404 returned error can't find the container with id 0bee929e0840b2288d4fd4115f043953aa07afa621d6e24e754352021c2a8399
Aug 04 16:00:00.377341 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.377318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"]
Aug 04 16:00:00.380201 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:00:00.380169    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b46a130_d6ad_4e45_b61b_e46aa6c3d135.slice/crio-fb05e68ef040e3d86093feed2854a4486f59225ac42ed90bf4fa43698e86632d WatchSource:0}: Error finding container fb05e68ef040e3d86093feed2854a4486f59225ac42ed90bf4fa43698e86632d: Status 404 returned error can't find the container with id fb05e68ef040e3d86093feed2854a4486f59225ac42ed90bf4fa43698e86632d
Aug 04 16:00:00.405118 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.405084    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"]
Aug 04 16:00:00.605061 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.605028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs" event={"ID":"91b5945c-eb40-4f1e-99e8-70f248305d04","Type":"ContainerStarted","Data":"dd19feb35d0520b41814e474eef047d1acb556018f1f8a4530937aee1452f4ff"}
Aug 04 16:00:00.605213 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.605134    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs" event={"ID":"91b5945c-eb40-4f1e-99e8-70f248305d04","Type":"ContainerStarted","Data":"1c25c8a87e2eb4eb971a41ae57481db0d2248a186b9d42af02034e95d4f1557f"}
Aug 04 16:00:00.606141 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.606117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m" event={"ID":"6b46a130-d6ad-4e45-b61b-e46aa6c3d135","Type":"ContainerStarted","Data":"fb05e68ef040e3d86093feed2854a4486f59225ac42ed90bf4fa43698e86632d"}
Aug 04 16:00:00.607133 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.607112    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs" event={"ID":"457e6773-2cbb-4c37-b3da-02f668882d84","Type":"ContainerStarted","Data":"0bee929e0840b2288d4fd4115f043953aa07afa621d6e24e754352021c2a8399"}
Aug 04 16:00:00.622044 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:00.621992    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs" podStartSLOduration=0.62197928 podStartE2EDuration="621.97928ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:00:00.621756133 +0000 UTC m=+3214.836768931" watchObservedRunningTime="2026-08-04 16:00:00.62197928 +0000 UTC m=+3214.836992075"
Aug 04 16:00:01.613645 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:01.613514    2581 generic.go:356] "Generic (PLEG): container finished" podID="91b5945c-eb40-4f1e-99e8-70f248305d04" containerID="dd19feb35d0520b41814e474eef047d1acb556018f1f8a4530937aee1452f4ff" exitCode=0
Aug 04 16:00:01.613645 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:01.613609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs" event={"ID":"91b5945c-eb40-4f1e-99e8-70f248305d04","Type":"ContainerDied","Data":"dd19feb35d0520b41814e474eef047d1acb556018f1f8a4530937aee1452f4ff"}
Aug 04 16:00:01.615112 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:01.615091    2581 generic.go:356] "Generic (PLEG): container finished" podID="6b46a130-d6ad-4e45-b61b-e46aa6c3d135" containerID="19be1c4b800e7fb933e6495b422bb33f21f0017823b45804c104e13d1133b2a2" exitCode=0
Aug 04 16:00:01.615192 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:01.615156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m" event={"ID":"6b46a130-d6ad-4e45-b61b-e46aa6c3d135","Type":"ContainerDied","Data":"19be1c4b800e7fb933e6495b422bb33f21f0017823b45804c104e13d1133b2a2"}
Aug 04 16:00:01.616558 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:01.616519    2581 generic.go:356] "Generic (PLEG): container finished" podID="457e6773-2cbb-4c37-b3da-02f668882d84" containerID="4478b08213c50fbb776ea98de1cb4d153a5d0ce5b719a80a3ea73303d23922e3" exitCode=0
Aug 04 16:00:01.616660 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:01.616565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs" event={"ID":"457e6773-2cbb-4c37-b3da-02f668882d84","Type":"ContainerDied","Data":"4478b08213c50fbb776ea98de1cb4d153a5d0ce5b719a80a3ea73303d23922e3"}
Aug 04 16:00:02.765365 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:02.765330    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"
Aug 04 16:00:02.797929 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:02.797901    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"
Aug 04 16:00:02.802574 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:02.802546    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"
Aug 04 16:00:03.626938 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.626895    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"
Aug 04 16:00:03.626938 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.626923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs" event={"ID":"91b5945c-eb40-4f1e-99e8-70f248305d04","Type":"ContainerDied","Data":"1c25c8a87e2eb4eb971a41ae57481db0d2248a186b9d42af02034e95d4f1557f"}
Aug 04 16:00:03.627191 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.626971    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c25c8a87e2eb4eb971a41ae57481db0d2248a186b9d42af02034e95d4f1557f"
Aug 04 16:00:03.628295 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.628267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m" event={"ID":"6b46a130-d6ad-4e45-b61b-e46aa6c3d135","Type":"ContainerDied","Data":"fb05e68ef040e3d86093feed2854a4486f59225ac42ed90bf4fa43698e86632d"}
Aug 04 16:00:03.628426 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.628318    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb05e68ef040e3d86093feed2854a4486f59225ac42ed90bf4fa43698e86632d"
Aug 04 16:00:03.628426 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.628278    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764320-tjb6m"
Aug 04 16:00:03.629684 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.629665    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"
Aug 04 16:00:03.629797 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.629662    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs" event={"ID":"457e6773-2cbb-4c37-b3da-02f668882d84","Type":"ContainerDied","Data":"0bee929e0840b2288d4fd4115f043953aa07afa621d6e24e754352021c2a8399"}
Aug 04 16:00:03.629797 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:03.629792    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bee929e0840b2288d4fd4115f043953aa07afa621d6e24e754352021c2a8399"
Aug 04 16:00:26.624459 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:26.624384    2581 scope.go:117] "RemoveContainer" containerID="8350c7463747c99bcfa8e0f9023ee8300221ab6372f45a4d1ab1fb29f02a665d"
Aug 04 16:00:26.632288 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:26.632267    2581 scope.go:117] "RemoveContainer" containerID="c375ba595be7f623f0563155924d142c4898c9ade7f0db564892452ddfafad7b"
Aug 04 16:00:44.988650 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:44.988612    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"]
Aug 04 16:00:55.801383 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801349    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"]
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801689    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b46a130-d6ad-4e45-b61b-e46aa6c3d135" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801701    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b46a130-d6ad-4e45-b61b-e46aa6c3d135" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801710    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="457e6773-2cbb-4c37-b3da-02f668882d84" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801715    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="457e6773-2cbb-4c37-b3da-02f668882d84" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801722    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b5945c-eb40-4f1e-99e8-70f248305d04" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801727    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b5945c-eb40-4f1e-99e8-70f248305d04" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801775    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="457e6773-2cbb-4c37-b3da-02f668882d84" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801782    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b5945c-eb40-4f1e-99e8-70f248305d04" containerName="cleanup"
Aug 04 16:00:55.801801 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.801788    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b46a130-d6ad-4e45-b61b-e46aa6c3d135" containerName="cleanup"
Aug 04 16:00:55.804688 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.804667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.809131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.809105    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-05b2bc\"/\"openshift-service-ca.crt\""
Aug 04 16:00:55.809131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.809141    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-05b2bc\"/\"kube-root-ca.crt\""
Aug 04 16:00:55.809349 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.809159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-05b2bc\"/\"default-dockercfg-4nsxr\""
Aug 04 16:00:55.809349 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.809217    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-05b2bc\"/\"sub-test-model-05b2bc-kserve-self-signed-certs\""
Aug 04 16:00:55.814723 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.814690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"]
Aug 04 16:00:55.846104 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.846063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-home\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.846104 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.846099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdg2r\" (UniqueName: \"kubernetes.io/projected/68712e93-8def-478d-b165-52fab2f021aa-kube-api-access-sdg2r\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.846325 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.846119    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68712e93-8def-478d-b165-52fab2f021aa-tls-certs\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.846325 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.846213    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-dshm\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.846325 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.846276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-model-cache\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.846460 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.846353    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-tmp-dir\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.947768 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.947723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-model-cache\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.947948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.947798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-tmp-dir\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.947948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.947837    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-home\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.947948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.947854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdg2r\" (UniqueName: \"kubernetes.io/projected/68712e93-8def-478d-b165-52fab2f021aa-kube-api-access-sdg2r\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.948112 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.948004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68712e93-8def-478d-b165-52fab2f021aa-tls-certs\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.948112 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.948058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-dshm\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.948210 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.948130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-model-cache\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.948210 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.948171    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-home\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.948210 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.948200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-tmp-dir\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.950358 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.950337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-dshm\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.950667 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.950639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68712e93-8def-478d-b165-52fab2f021aa-tls-certs\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:55.956572 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:55.956522    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdg2r\" (UniqueName: \"kubernetes.io/projected/68712e93-8def-478d-b165-52fab2f021aa-kube-api-access-sdg2r\") pod \"sub-test-model-05b2bc-kserve-77684b65c5-qdxdt\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") " pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:56.114259 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:56.114152    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:00:56.256933 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:56.256889    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"]
Aug 04 16:00:56.261325 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:00:56.261283    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68712e93_8def_478d_b165_52fab2f021aa.slice/crio-9dce61ec4ad15bd405cb6d74247918ac3cadb01ae05ee3ef358286270964500d WatchSource:0}: Error finding container 9dce61ec4ad15bd405cb6d74247918ac3cadb01ae05ee3ef358286270964500d: Status 404 returned error can't find the container with id 9dce61ec4ad15bd405cb6d74247918ac3cadb01ae05ee3ef358286270964500d
Aug 04 16:00:56.860282 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:56.860243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt" event={"ID":"68712e93-8def-478d-b165-52fab2f021aa","Type":"ContainerStarted","Data":"f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42"}
Aug 04 16:00:56.860282 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:56.860285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt" event={"ID":"68712e93-8def-478d-b165-52fab2f021aa","Type":"ContainerStarted","Data":"9dce61ec4ad15bd405cb6d74247918ac3cadb01ae05ee3ef358286270964500d"}
Aug 04 16:00:56.880450 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:00:56.880391    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt" podStartSLOduration=1.8803728 podStartE2EDuration="1.8803728s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:00:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:00:56.879370147 +0000 UTC m=+3271.094382956" watchObservedRunningTime="2026-08-04 16:00:56.8803728 +0000 UTC m=+3271.095385595"
Aug 04 16:01:00.007711 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.007669    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp" podUID="864609e7-9c12-4011-9b5f-51f759ccdf0b" containerName="main" containerID="cri-o://fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777" gracePeriod=45
Aug 04 16:01:00.260680 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.260599    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 16:01:00.285288 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285262    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-dshm\") pod \"864609e7-9c12-4011-9b5f-51f759ccdf0b\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") "
Aug 04 16:01:00.285477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285332    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/864609e7-9c12-4011-9b5f-51f759ccdf0b-tls-certs\") pod \"864609e7-9c12-4011-9b5f-51f759ccdf0b\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") "
Aug 04 16:01:00.285477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-home\") pod \"864609e7-9c12-4011-9b5f-51f759ccdf0b\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") "
Aug 04 16:01:00.285477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-tmp-dir\") pod \"864609e7-9c12-4011-9b5f-51f759ccdf0b\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") "
Aug 04 16:01:00.285477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh2vj\" (UniqueName: \"kubernetes.io/projected/864609e7-9c12-4011-9b5f-51f759ccdf0b-kube-api-access-bh2vj\") pod \"864609e7-9c12-4011-9b5f-51f759ccdf0b\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") "
Aug 04 16:01:00.285477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285473    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-model-cache\") pod \"864609e7-9c12-4011-9b5f-51f759ccdf0b\" (UID: \"864609e7-9c12-4011-9b5f-51f759ccdf0b\") "
Aug 04 16:01:00.285777 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285667    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-home" (OuterVolumeSpecName: "home") pod "864609e7-9c12-4011-9b5f-51f759ccdf0b" (UID: "864609e7-9c12-4011-9b5f-51f759ccdf0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:01:00.285836 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285787    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-home\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:01:00.285891 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285849    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-model-cache" (OuterVolumeSpecName: "model-cache") pod "864609e7-9c12-4011-9b5f-51f759ccdf0b" (UID: "864609e7-9c12-4011-9b5f-51f759ccdf0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:01:00.285974 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.285945    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "864609e7-9c12-4011-9b5f-51f759ccdf0b" (UID: "864609e7-9c12-4011-9b5f-51f759ccdf0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:01:00.287682 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.287660    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-dshm" (OuterVolumeSpecName: "dshm") pod "864609e7-9c12-4011-9b5f-51f759ccdf0b" (UID: "864609e7-9c12-4011-9b5f-51f759ccdf0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:01:00.288197 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.288173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/864609e7-9c12-4011-9b5f-51f759ccdf0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "864609e7-9c12-4011-9b5f-51f759ccdf0b" (UID: "864609e7-9c12-4011-9b5f-51f759ccdf0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:01:00.288287 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.288196    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/864609e7-9c12-4011-9b5f-51f759ccdf0b-kube-api-access-bh2vj" (OuterVolumeSpecName: "kube-api-access-bh2vj") pod "864609e7-9c12-4011-9b5f-51f759ccdf0b" (UID: "864609e7-9c12-4011-9b5f-51f759ccdf0b"). InnerVolumeSpecName "kube-api-access-bh2vj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:01:00.386220 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.386184    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-model-cache\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:01:00.386220 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.386215    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-dshm\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:01:00.386220 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.386224    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/864609e7-9c12-4011-9b5f-51f759ccdf0b-tls-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:01:00.386463 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.386232    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/864609e7-9c12-4011-9b5f-51f759ccdf0b-tmp-dir\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:01:00.386463 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.386241    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh2vj\" (UniqueName: \"kubernetes.io/projected/864609e7-9c12-4011-9b5f-51f759ccdf0b-kube-api-access-bh2vj\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:01:00.877891 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.877855    2581 generic.go:356] "Generic (PLEG): container finished" podID="864609e7-9c12-4011-9b5f-51f759ccdf0b" containerID="fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777" exitCode=0
Aug 04 16:01:00.878073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.877896    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"
Aug 04 16:01:00.878073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.877910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp" event={"ID":"864609e7-9c12-4011-9b5f-51f759ccdf0b","Type":"ContainerDied","Data":"fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777"}
Aug 04 16:01:00.878073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.877950    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp" event={"ID":"864609e7-9c12-4011-9b5f-51f759ccdf0b","Type":"ContainerDied","Data":"12ac9d167fb3587a5b293c501f4c9495f57ed0a384d6fa38d0e651b2a7544993"}
Aug 04 16:01:00.878073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.877971    2581 scope.go:117] "RemoveContainer" containerID="fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777"
Aug 04 16:01:00.886149 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.886130    2581 scope.go:117] "RemoveContainer" containerID="fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777"
Aug 04 16:01:00.886401 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:01:00.886383    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777\": container with ID starting with fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777 not found: ID does not exist" containerID="fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777"
Aug 04 16:01:00.886464 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.886420    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777"} err="failed to get container status \"fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777\": rpc error: code = NotFound desc = could not find container \"fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777\": container with ID starting with fb4013ff3d5d7e343bf416925cb4de52d787ec60b69dd3f609e9b3eff0ee7777 not found: ID does not exist"
Aug 04 16:01:00.896146 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.896119    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"]
Aug 04 16:01:00.900415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:00.900387    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/auth-test-model-7b41f3-kserve-fb56b8b6c-wglcp"]
Aug 04 16:01:02.301491 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:02.301461    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="864609e7-9c12-4011-9b5f-51f759ccdf0b" path="/var/lib/kubelet/pods/864609e7-9c12-4011-9b5f-51f759ccdf0b/volumes"
Aug 04 16:01:06.117626 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:06.117557    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:01:06.118143 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:06.117647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:01:06.131080 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:06.131048    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:01:06.916301 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:06.916270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:01:25.004644 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.004602    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"]
Aug 04 16:01:25.005058 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.004948    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="864609e7-9c12-4011-9b5f-51f759ccdf0b" containerName="main"
Aug 04 16:01:25.005058 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.004959    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="864609e7-9c12-4011-9b5f-51f759ccdf0b" containerName="main"
Aug 04 16:01:25.005058 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.005013    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="864609e7-9c12-4011-9b5f-51f759ccdf0b" containerName="main"
Aug 04 16:01:25.008011 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.007986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.011255 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.011231    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"openshift-service-ca.crt\""
Aug 04 16:01:25.011358 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.011235    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"kube-root-ca.crt\""
Aug 04 16:01:25.012640 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.012617    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"default-dockercfg-6xmxr\""
Aug 04 16:01:25.012739 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.012623    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"sub-test-model-7b41f3-kserve-self-signed-certs\""
Aug 04 16:01:25.020763 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.020731    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"]
Aug 04 16:01:25.102312 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.102269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-dshm\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.102312 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.102308    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gznrt\" (UniqueName: \"kubernetes.io/projected/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-kube-api-access-gznrt\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.102595 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.102351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tmp-dir\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.102595 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.102373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-model-cache\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.102595 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.102397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tls-certs\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.102595 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.102463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-home\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203274 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-dshm\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203274 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203272    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gznrt\" (UniqueName: \"kubernetes.io/projected/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-kube-api-access-gznrt\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203511 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tmp-dir\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203511 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-model-cache\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203511 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tls-certs\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203511 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-home\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203817 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tmp-dir\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203881 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-model-cache\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.203881 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.203869    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-home\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.205737 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.205707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-dshm\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.205967 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.205952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tls-certs\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.213042 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.213023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gznrt\" (UniqueName: \"kubernetes.io/projected/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-kube-api-access-gznrt\") pod \"sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") " pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.318047 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.317954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:25.453735 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.453704    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"]
Aug 04 16:01:25.455848 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:01:25.455821    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3f35a39_44b4_4cbf_87bf_bf05bb2fe7e8.slice/crio-6bf6056d20ffee229ec605945b5879f038b74c47e30ad90b5982c67441f9667f WatchSource:0}: Error finding container 6bf6056d20ffee229ec605945b5879f038b74c47e30ad90b5982c67441f9667f: Status 404 returned error can't find the container with id 6bf6056d20ffee229ec605945b5879f038b74c47e30ad90b5982c67441f9667f
Aug 04 16:01:25.993516 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.993470    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl" event={"ID":"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8","Type":"ContainerStarted","Data":"87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb"}
Aug 04 16:01:25.993516 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:25.993518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl" event={"ID":"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8","Type":"ContainerStarted","Data":"6bf6056d20ffee229ec605945b5879f038b74c47e30ad90b5982c67441f9667f"}
Aug 04 16:01:26.016765 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:26.016712    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl" podStartSLOduration=2.016691931 podStartE2EDuration="2.016691931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:01:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:01:26.01445483 +0000 UTC m=+3300.229467627" watchObservedRunningTime="2026-08-04 16:01:26.016691931 +0000 UTC m=+3300.231704726"
Aug 04 16:01:35.318639 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:35.318591    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:35.318639 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:35.318645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:35.330949 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:35.330926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:01:36.052070 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:01:36.052025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:03:11.407460 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:11.407421    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"]
Aug 04 16:03:12.219390 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:12.219350    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"]
Aug 04 16:03:26.426318 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.426257    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt" podUID="68712e93-8def-478d-b165-52fab2f021aa" containerName="main" containerID="cri-o://f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42" gracePeriod=45
Aug 04 16:03:26.672556 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.672516    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:03:26.825602 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825509    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-model-cache\") pod \"68712e93-8def-478d-b165-52fab2f021aa\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") "
Aug 04 16:03:26.825602 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825568    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdg2r\" (UniqueName: \"kubernetes.io/projected/68712e93-8def-478d-b165-52fab2f021aa-kube-api-access-sdg2r\") pod \"68712e93-8def-478d-b165-52fab2f021aa\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") "
Aug 04 16:03:26.825841 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825623    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-dshm\") pod \"68712e93-8def-478d-b165-52fab2f021aa\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") "
Aug 04 16:03:26.825841 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825661    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68712e93-8def-478d-b165-52fab2f021aa-tls-certs\") pod \"68712e93-8def-478d-b165-52fab2f021aa\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") "
Aug 04 16:03:26.825841 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825675    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-tmp-dir\") pod \"68712e93-8def-478d-b165-52fab2f021aa\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") "
Aug 04 16:03:26.825841 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825711    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-home\") pod \"68712e93-8def-478d-b165-52fab2f021aa\" (UID: \"68712e93-8def-478d-b165-52fab2f021aa\") "
Aug 04 16:03:26.825841 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "68712e93-8def-478d-b165-52fab2f021aa" (UID: "68712e93-8def-478d-b165-52fab2f021aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:26.826039 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.825996    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68712e93-8def-478d-b165-52fab2f021aa" (UID: "68712e93-8def-478d-b165-52fab2f021aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:26.826081 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.826033    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-home" (OuterVolumeSpecName: "home") pod "68712e93-8def-478d-b165-52fab2f021aa" (UID: "68712e93-8def-478d-b165-52fab2f021aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:26.828103 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.828076    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-dshm" (OuterVolumeSpecName: "dshm") pod "68712e93-8def-478d-b165-52fab2f021aa" (UID: "68712e93-8def-478d-b165-52fab2f021aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:26.828103 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.828087    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68712e93-8def-478d-b165-52fab2f021aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68712e93-8def-478d-b165-52fab2f021aa" (UID: "68712e93-8def-478d-b165-52fab2f021aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:03:26.828248 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.828174    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68712e93-8def-478d-b165-52fab2f021aa-kube-api-access-sdg2r" (OuterVolumeSpecName: "kube-api-access-sdg2r") pod "68712e93-8def-478d-b165-52fab2f021aa" (UID: "68712e93-8def-478d-b165-52fab2f021aa"). InnerVolumeSpecName "kube-api-access-sdg2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:03:26.926447 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.926397    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68712e93-8def-478d-b165-52fab2f021aa-tls-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:26.926447 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.926439    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-tmp-dir\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:26.926447 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.926448    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-home\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:26.926447 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.926456    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-model-cache\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:26.926743 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.926464    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdg2r\" (UniqueName: \"kubernetes.io/projected/68712e93-8def-478d-b165-52fab2f021aa-kube-api-access-sdg2r\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:26.926743 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:26.926473    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68712e93-8def-478d-b165-52fab2f021aa-dshm\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.238338 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.238289    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl" podUID="d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" containerName="main" containerID="cri-o://87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb" gracePeriod=45
Aug 04 16:03:27.477660 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.477631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:03:27.528235 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.528151    2581 generic.go:356] "Generic (PLEG): container finished" podID="68712e93-8def-478d-b165-52fab2f021aa" containerID="f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42" exitCode=0
Aug 04 16:03:27.528235 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.528196    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"
Aug 04 16:03:27.528451 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.528228    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt" event={"ID":"68712e93-8def-478d-b165-52fab2f021aa","Type":"ContainerDied","Data":"f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42"}
Aug 04 16:03:27.528451 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.528270    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt" event={"ID":"68712e93-8def-478d-b165-52fab2f021aa","Type":"ContainerDied","Data":"9dce61ec4ad15bd405cb6d74247918ac3cadb01ae05ee3ef358286270964500d"}
Aug 04 16:03:27.528451 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.528289    2581 scope.go:117] "RemoveContainer" containerID="f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42"
Aug 04 16:03:27.529969 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.529879    2581 generic.go:356] "Generic (PLEG): container finished" podID="d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" containerID="87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb" exitCode=0
Aug 04 16:03:27.529969 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.529912    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"
Aug 04 16:03:27.530136 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.529901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl" event={"ID":"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8","Type":"ContainerDied","Data":"87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb"}
Aug 04 16:03:27.530136 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.530016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl" event={"ID":"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8","Type":"ContainerDied","Data":"6bf6056d20ffee229ec605945b5879f038b74c47e30ad90b5982c67441f9667f"}
Aug 04 16:03:27.537107 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.537089    2581 scope.go:117] "RemoveContainer" containerID="f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42"
Aug 04 16:03:27.537406 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:03:27.537386    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42\": container with ID starting with f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42 not found: ID does not exist" containerID="f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42"
Aug 04 16:03:27.537474 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.537416    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42"} err="failed to get container status \"f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42\": rpc error: code = NotFound desc = could not find container \"f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42\": container with ID starting with f64385e616e00a8178eb5111912180e405b5afafba6b8e7270add6b0ba08be42 not found: ID does not exist"
Aug 04 16:03:27.537474 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.537436    2581 scope.go:117] "RemoveContainer" containerID="87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb"
Aug 04 16:03:27.546011 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.545980    2581 scope.go:117] "RemoveContainer" containerID="87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb"
Aug 04 16:03:27.546312 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:03:27.546292    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb\": container with ID starting with 87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb not found: ID does not exist" containerID="87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb"
Aug 04 16:03:27.546387 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.546322    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb"} err="failed to get container status \"87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb\": rpc error: code = NotFound desc = could not find container \"87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb\": container with ID starting with 87bd5a935bc577079f748914f65e4e29e9eaa58c87b500e13a093a40e6514bdb not found: ID does not exist"
Aug 04 16:03:27.567748 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.567713    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"]
Aug 04 16:03:27.578545 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.578491    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-05b2bc/sub-test-model-05b2bc-kserve-77684b65c5-qdxdt"]
Aug 04 16:03:27.631541 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631513    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-home\") pod \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") "
Aug 04 16:03:27.631668 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-model-cache\") pod \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") "
Aug 04 16:03:27.631668 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631611    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tmp-dir\") pod \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") "
Aug 04 16:03:27.631668 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-dshm\") pod \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") "
Aug 04 16:03:27.631817 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631681    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tls-certs\") pod \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") "
Aug 04 16:03:27.631817 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631747    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gznrt\" (UniqueName: \"kubernetes.io/projected/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-kube-api-access-gznrt\") pod \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\" (UID: \"d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8\") "
Aug 04 16:03:27.631817 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631781    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-home" (OuterVolumeSpecName: "home") pod "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" (UID: "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:27.631968 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" (UID: "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:27.631968 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.631893    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-model-cache" (OuterVolumeSpecName: "model-cache") pod "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" (UID: "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:27.632084 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.632031    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-home\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.632084 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.632045    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-model-cache\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.632084 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.632056    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tmp-dir\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.633926 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.633894    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-dshm" (OuterVolumeSpecName: "dshm") pod "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" (UID: "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:03:27.634022 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.633956    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" (UID: "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:03:27.634022 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.633980    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-kube-api-access-gznrt" (OuterVolumeSpecName: "kube-api-access-gznrt") pod "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" (UID: "d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8"). InnerVolumeSpecName "kube-api-access-gznrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:03:27.733431 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.733391    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-dshm\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.733431 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.733423    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-tls-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.733431 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.733436    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gznrt\" (UniqueName: \"kubernetes.io/projected/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8-kube-api-access-gznrt\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:03:27.857401 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.857365    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"]
Aug 04 16:03:27.875511 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:27.875472    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/sub-test-model-7b41f3-kserve-9b5fbd789-xp9jl"]
Aug 04 16:03:28.302131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:28.302099    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68712e93-8def-478d-b165-52fab2f021aa" path="/var/lib/kubelet/pods/68712e93-8def-478d-b165-52fab2f021aa/volumes"
Aug 04 16:03:28.302492 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:28.302478    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" path="/var/lib/kubelet/pods/d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8/volumes"
Aug 04 16:03:41.510948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.510912    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"]
Aug 04 16:03:41.511404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.511222    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68712e93-8def-478d-b165-52fab2f021aa" containerName="main"
Aug 04 16:03:41.511404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.511234    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="68712e93-8def-478d-b165-52fab2f021aa" containerName="main"
Aug 04 16:03:41.511404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.511248    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" containerName="main"
Aug 04 16:03:41.511404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.511253    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" containerName="main"
Aug 04 16:03:41.511404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.511298    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="68712e93-8def-478d-b165-52fab2f021aa" containerName="main"
Aug 04 16:03:41.511404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.511307    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3f35a39-44b4-4cbf-87bf-bf05bb2fe7e8" containerName="main"
Aug 04 16:03:41.514152 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.514131    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.518259 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.518231    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"kube-root-ca.crt\""
Aug 04 16:03:41.518371 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.518303    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"default-dockercfg-6xmxr\""
Aug 04 16:03:41.518371 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.518248    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"openshift-service-ca.crt\""
Aug 04 16:03:41.518371 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.518231    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-7b41f3\"/\"rate-test-model-7b41f3-kserve-self-signed-certs\""
Aug 04 16:03:41.525016 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.524992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"]
Aug 04 16:03:41.544390 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.544367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-model-cache\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.544548 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.544396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfr24\" (UniqueName: \"kubernetes.io/projected/f59f0312-1884-42ee-a957-78b61369ecd1-kube-api-access-tfr24\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.544548 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.544433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59f0312-1884-42ee-a957-78b61369ecd1-tls-certs\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.544621 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.544545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-dshm\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.544621 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.544576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-tmp-dir\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.544621 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.544601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-home\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.645620 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.645586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-dshm\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.645793 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.645630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-tmp-dir\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.645793 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.645661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-home\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.645793 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.645714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-model-cache\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.645793 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.645738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfr24\" (UniqueName: \"kubernetes.io/projected/f59f0312-1884-42ee-a957-78b61369ecd1-kube-api-access-tfr24\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.645793 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.645765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59f0312-1884-42ee-a957-78b61369ecd1-tls-certs\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.646278 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.646176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-home\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.646278 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.646221    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-tmp-dir\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.646659 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.646635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-model-cache\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.648069 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.648045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-dshm\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.648367 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.648345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59f0312-1884-42ee-a957-78b61369ecd1-tls-certs\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.662173 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.662143    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfr24\" (UniqueName: \"kubernetes.io/projected/f59f0312-1884-42ee-a957-78b61369ecd1-kube-api-access-tfr24\") pod \"rate-test-model-7b41f3-kserve-847d8b998c-ft2h7\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") " pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.823387 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.823291    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:41.962560 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:41.962502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"]
Aug 04 16:03:41.963593 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:03:41.963570    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf59f0312_1884_42ee_a957_78b61369ecd1.slice/crio-a81360cdf7e41a5f16083b258b8eb86940732f0887cf4aecda485508139d29df WatchSource:0}: Error finding container a81360cdf7e41a5f16083b258b8eb86940732f0887cf4aecda485508139d29df: Status 404 returned error can't find the container with id a81360cdf7e41a5f16083b258b8eb86940732f0887cf4aecda485508139d29df
Aug 04 16:03:42.598978 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:42.598941    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7" event={"ID":"f59f0312-1884-42ee-a957-78b61369ecd1","Type":"ContainerStarted","Data":"c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47"}
Aug 04 16:03:42.599431 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:42.598991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7" event={"ID":"f59f0312-1884-42ee-a957-78b61369ecd1","Type":"ContainerStarted","Data":"a81360cdf7e41a5f16083b258b8eb86940732f0887cf4aecda485508139d29df"}
Aug 04 16:03:42.619231 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:42.619178    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7" podStartSLOduration=1.619163269 podStartE2EDuration="1.619163269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:03:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:03:42.618478619 +0000 UTC m=+3436.833491415" watchObservedRunningTime="2026-08-04 16:03:42.619163269 +0000 UTC m=+3436.834176065"
Aug 04 16:03:51.823618 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:51.823579    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:51.824026 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:51.823669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:51.835912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:51.835888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:03:52.653201 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:03:52.653163    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:05:30.683754 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:30.683723    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"]
Aug 04 16:05:31.677817 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.677781    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7386-140234341612976"]
Aug 04 16:05:31.680925 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.680904    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:31.684548 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.684513    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nnz2r\""
Aug 04 16:05:31.692578 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.692550    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341612976"]
Aug 04 16:05:31.799589 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.799553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj88v\" (UniqueName: \"kubernetes.io/projected/d250885e-9bb4-45b8-aa7c-8a226f2fb75c-kube-api-access-jj88v\") pod \"test-curl-7386-140234341612976\" (UID: \"d250885e-9bb4-45b8-aa7c-8a226f2fb75c\") " pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:31.900773 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.900730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj88v\" (UniqueName: \"kubernetes.io/projected/d250885e-9bb4-45b8-aa7c-8a226f2fb75c-kube-api-access-jj88v\") pod \"test-curl-7386-140234341612976\" (UID: \"d250885e-9bb4-45b8-aa7c-8a226f2fb75c\") " pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:31.910927 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.910892    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj88v\" (UniqueName: \"kubernetes.io/projected/d250885e-9bb4-45b8-aa7c-8a226f2fb75c-kube-api-access-jj88v\") pod \"test-curl-7386-140234341612976\" (UID: \"d250885e-9bb4-45b8-aa7c-8a226f2fb75c\") " pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:31.989736 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:31.989642    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:32.125731 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:32.125700    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341612976"]
Aug 04 16:05:32.128137 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:05:32.128112    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd250885e_9bb4_45b8_aa7c_8a226f2fb75c.slice/crio-b33a950a6c88ac60f6b5a8ea1c77bfae107dd7c7936a52883fe5496dbb7ebfe8 WatchSource:0}: Error finding container b33a950a6c88ac60f6b5a8ea1c77bfae107dd7c7936a52883fe5496dbb7ebfe8: Status 404 returned error can't find the container with id b33a950a6c88ac60f6b5a8ea1c77bfae107dd7c7936a52883fe5496dbb7ebfe8
Aug 04 16:05:32.129413 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:32.129394    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:05:33.084659 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:33.084571    2581 generic.go:356] "Generic (PLEG): container finished" podID="d250885e-9bb4-45b8-aa7c-8a226f2fb75c" containerID="c3c10cb36a219a81f9042bb61fee0ea6d66c7976c81f6822c911007428c2389a" exitCode=0
Aug 04 16:05:33.085031 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:33.084666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341612976" event={"ID":"d250885e-9bb4-45b8-aa7c-8a226f2fb75c","Type":"ContainerDied","Data":"c3c10cb36a219a81f9042bb61fee0ea6d66c7976c81f6822c911007428c2389a"}
Aug 04 16:05:33.085031 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:33.084712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341612976" event={"ID":"d250885e-9bb4-45b8-aa7c-8a226f2fb75c","Type":"ContainerStarted","Data":"b33a950a6c88ac60f6b5a8ea1c77bfae107dd7c7936a52883fe5496dbb7ebfe8"}
Aug 04 16:05:34.220081 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.220057    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:34.266603 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.266571    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7386-140234341612976_d250885e-9bb4-45b8-aa7c-8a226f2fb75c/test-curl-7386-140234341612976/0.log"
Aug 04 16:05:34.294240 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.294207    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7386-140234341612976"]
Aug 04 16:05:34.296490 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.296467    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7386-140234341612976"]
Aug 04 16:05:34.322525 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.322496    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj88v\" (UniqueName: \"kubernetes.io/projected/d250885e-9bb4-45b8-aa7c-8a226f2fb75c-kube-api-access-jj88v\") pod \"d250885e-9bb4-45b8-aa7c-8a226f2fb75c\" (UID: \"d250885e-9bb4-45b8-aa7c-8a226f2fb75c\") "
Aug 04 16:05:34.324771 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.324743    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d250885e-9bb4-45b8-aa7c-8a226f2fb75c-kube-api-access-jj88v" (OuterVolumeSpecName: "kube-api-access-jj88v") pod "d250885e-9bb4-45b8-aa7c-8a226f2fb75c" (UID: "d250885e-9bb4-45b8-aa7c-8a226f2fb75c"). InnerVolumeSpecName "kube-api-access-jj88v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:34.423217 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.423187    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj88v\" (UniqueName: \"kubernetes.io/projected/d250885e-9bb4-45b8-aa7c-8a226f2fb75c-kube-api-access-jj88v\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:34.424601 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.424580    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7386-140234341610800"]
Aug 04 16:05:34.424863 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.424851    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d250885e-9bb4-45b8-aa7c-8a226f2fb75c" containerName="test-curl-7386-140234341612976"
Aug 04 16:05:34.424906 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.424865    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d250885e-9bb4-45b8-aa7c-8a226f2fb75c" containerName="test-curl-7386-140234341612976"
Aug 04 16:05:34.424940 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.424914    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d250885e-9bb4-45b8-aa7c-8a226f2fb75c" containerName="test-curl-7386-140234341612976"
Aug 04 16:05:34.427734 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.427719    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:34.432396 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.432370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341610800"]
Aug 04 16:05:34.524191 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.524145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnm2q\" (UniqueName: \"kubernetes.io/projected/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5-kube-api-access-fnm2q\") pod \"test-curl-7386-140234341610800\" (UID: \"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5\") " pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:34.625354 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.625318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnm2q\" (UniqueName: \"kubernetes.io/projected/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5-kube-api-access-fnm2q\") pod \"test-curl-7386-140234341610800\" (UID: \"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5\") " pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:34.636781 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.636745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnm2q\" (UniqueName: \"kubernetes.io/projected/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5-kube-api-access-fnm2q\") pod \"test-curl-7386-140234341610800\" (UID: \"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5\") " pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:34.738146 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.738059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:34.878330 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:34.878303    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341610800"]
Aug 04 16:05:34.880817 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:05:34.880791    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c0ad948_d0ab_4f23_8e5f_d8ed497945d5.slice/crio-c0d7d79856c563688c5182444bc96f57342ee9ae42f697f9676890826aad8a05 WatchSource:0}: Error finding container c0d7d79856c563688c5182444bc96f57342ee9ae42f697f9676890826aad8a05: Status 404 returned error can't find the container with id c0d7d79856c563688c5182444bc96f57342ee9ae42f697f9676890826aad8a05
Aug 04 16:05:35.095080 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:35.094989    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341612976"
Aug 04 16:05:35.095080 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:35.095044    2581 scope.go:117] "RemoveContainer" containerID="c3c10cb36a219a81f9042bb61fee0ea6d66c7976c81f6822c911007428c2389a"
Aug 04 16:05:35.096453 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:35.096213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341610800" event={"ID":"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5","Type":"ContainerStarted","Data":"c0d7d79856c563688c5182444bc96f57342ee9ae42f697f9676890826aad8a05"}
Aug 04 16:05:36.101789 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:36.101752    2581 generic.go:356] "Generic (PLEG): container finished" podID="6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" containerID="e9c3d9f122d9f609df6e9a9369d3f86944fb822178ab965a03b04f6e0ec135d7" exitCode=0
Aug 04 16:05:36.102212 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:36.101852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341610800" event={"ID":"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5","Type":"ContainerDied","Data":"e9c3d9f122d9f609df6e9a9369d3f86944fb822178ab965a03b04f6e0ec135d7"}
Aug 04 16:05:36.302800 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:36.302768    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d250885e-9bb4-45b8-aa7c-8a226f2fb75c" path="/var/lib/kubelet/pods/d250885e-9bb4-45b8-aa7c-8a226f2fb75c/volumes"
Aug 04 16:05:37.237819 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.237772    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:37.264492 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.264465    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7386-140234341610800_6c0ad948-d0ab-4f23-8e5f-d8ed497945d5/test-curl-7386-140234341610800/0.log"
Aug 04 16:05:37.291285 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.291257    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7386-140234341610800"]
Aug 04 16:05:37.296848 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.296829    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7386-140234341610800"]
Aug 04 16:05:37.349471 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.349438    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnm2q\" (UniqueName: \"kubernetes.io/projected/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5-kube-api-access-fnm2q\") pod \"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5\" (UID: \"6c0ad948-d0ab-4f23-8e5f-d8ed497945d5\") "
Aug 04 16:05:37.351781 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.351745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5-kube-api-access-fnm2q" (OuterVolumeSpecName: "kube-api-access-fnm2q") pod "6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" (UID: "6c0ad948-d0ab-4f23-8e5f-d8ed497945d5"). InnerVolumeSpecName "kube-api-access-fnm2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:37.450495 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.450449    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnm2q\" (UniqueName: \"kubernetes.io/projected/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5-kube-api-access-fnm2q\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:37.466085 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.466051    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:37.466545 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.466513    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" containerName="test-curl-7386-140234341610800"
Aug 04 16:05:37.466593 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.466550    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" containerName="test-curl-7386-140234341610800"
Aug 04 16:05:37.466657 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.466646    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" containerName="test-curl-7386-140234341610800"
Aug 04 16:05:37.469752 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.469733    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:37.479104 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.479037    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:37.551202 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.551165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxcsg\" (UniqueName: \"kubernetes.io/projected/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c-kube-api-access-gxcsg\") pod \"test-curl-7386-140234341530768\" (UID: \"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c\") " pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:37.652620 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.652575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxcsg\" (UniqueName: \"kubernetes.io/projected/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c-kube-api-access-gxcsg\") pod \"test-curl-7386-140234341530768\" (UID: \"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c\") " pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:37.665325 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.665289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxcsg\" (UniqueName: \"kubernetes.io/projected/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c-kube-api-access-gxcsg\") pod \"test-curl-7386-140234341530768\" (UID: \"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c\") " pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:37.780432 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.780327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:37.919560 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:37.919509    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:37.922935 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:05:37.922908    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c2a6858_6397_4196_9ade_2ea5e8a9fb6c.slice/crio-ef27891d7c50e70a8635ab63fd8ea19e8b2586de7e5ebc029f73bdc5e83512b1 WatchSource:0}: Error finding container ef27891d7c50e70a8635ab63fd8ea19e8b2586de7e5ebc029f73bdc5e83512b1: Status 404 returned error can't find the container with id ef27891d7c50e70a8635ab63fd8ea19e8b2586de7e5ebc029f73bdc5e83512b1
Aug 04 16:05:38.112944 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:38.112854    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341530768" event={"ID":"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c","Type":"ContainerStarted","Data":"ef27891d7c50e70a8635ab63fd8ea19e8b2586de7e5ebc029f73bdc5e83512b1"}
Aug 04 16:05:38.114161 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:38.114140    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0d7d79856c563688c5182444bc96f57342ee9ae42f697f9676890826aad8a05"
Aug 04 16:05:38.114289 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:38.114164    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:38.124880 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:05:38.124855    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7386-140234341610800\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" pod="opendatahub/test-curl-7386-140234341610800"
Aug 04 16:05:38.302100 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:38.302061    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c0ad948-d0ab-4f23-8e5f-d8ed497945d5" path="/var/lib/kubelet/pods/6c0ad948-d0ab-4f23-8e5f-d8ed497945d5/volumes"
Aug 04 16:05:39.119634 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:39.119598    2581 generic.go:356] "Generic (PLEG): container finished" podID="6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" containerID="66efad99135de12661d767f045355520cbb0f26e67249766313fc406c89d5d3b" exitCode=0
Aug 04 16:05:39.119803 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:39.119656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341530768" event={"ID":"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c","Type":"ContainerDied","Data":"66efad99135de12661d767f045355520cbb0f26e67249766313fc406c89d5d3b"}
Aug 04 16:05:40.258523 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.258496    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:40.282724 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.282697    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7386-140234341530768_6c2a6858-6397-4196-9ade-2ea5e8a9fb6c/test-curl-7386-140234341530768/0.log"
Aug 04 16:05:40.308091 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.308065    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:40.311954 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.311930    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:40.377019 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.376981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxcsg\" (UniqueName: \"kubernetes.io/projected/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c-kube-api-access-gxcsg\") pod \"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c\" (UID: \"6c2a6858-6397-4196-9ade-2ea5e8a9fb6c\") "
Aug 04 16:05:40.379181 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.379149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c-kube-api-access-gxcsg" (OuterVolumeSpecName: "kube-api-access-gxcsg") pod "6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" (UID: "6c2a6858-6397-4196-9ade-2ea5e8a9fb6c"). InnerVolumeSpecName "kube-api-access-gxcsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:40.442905 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.442872    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:40.443176 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.443164    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" containerName="test-curl-7386-140234341530768"
Aug 04 16:05:40.443220 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.443178    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" containerName="test-curl-7386-140234341530768"
Aug 04 16:05:40.443252 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.443226    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" containerName="test-curl-7386-140234341530768"
Aug 04 16:05:40.445988 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.445973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:40.451576 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.451549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:40.478685 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.478649    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxcsg\" (UniqueName: \"kubernetes.io/projected/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c-kube-api-access-gxcsg\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:40.579681 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.579600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjkkt\" (UniqueName: \"kubernetes.io/projected/71863ad7-9a72-495f-a17d-5dc124f7b6ba-kube-api-access-tjkkt\") pod \"test-curl-7386-140234341530768\" (UID: \"71863ad7-9a72-495f-a17d-5dc124f7b6ba\") " pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:40.680835 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.680799    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjkkt\" (UniqueName: \"kubernetes.io/projected/71863ad7-9a72-495f-a17d-5dc124f7b6ba-kube-api-access-tjkkt\") pod \"test-curl-7386-140234341530768\" (UID: \"71863ad7-9a72-495f-a17d-5dc124f7b6ba\") " pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:40.691638 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.691607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjkkt\" (UniqueName: \"kubernetes.io/projected/71863ad7-9a72-495f-a17d-5dc124f7b6ba-kube-api-access-tjkkt\") pod \"test-curl-7386-140234341530768\" (UID: \"71863ad7-9a72-495f-a17d-5dc124f7b6ba\") " pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:40.755620 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.755578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:40.889926 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:40.889901    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:40.891808 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:05:40.891779    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71863ad7_9a72_495f_a17d_5dc124f7b6ba.slice/crio-966f7639dbcf42b09d340ab3821ba6f03a0fe18dfe44abe0ca79b0e35eeee063 WatchSource:0}: Error finding container 966f7639dbcf42b09d340ab3821ba6f03a0fe18dfe44abe0ca79b0e35eeee063: Status 404 returned error can't find the container with id 966f7639dbcf42b09d340ab3821ba6f03a0fe18dfe44abe0ca79b0e35eeee063
Aug 04 16:05:41.130048 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:41.129956    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:41.130048 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:41.129977    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef27891d7c50e70a8635ab63fd8ea19e8b2586de7e5ebc029f73bdc5e83512b1"
Aug 04 16:05:41.131225 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:41.131196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341530768" event={"ID":"71863ad7-9a72-495f-a17d-5dc124f7b6ba","Type":"ContainerStarted","Data":"966f7639dbcf42b09d340ab3821ba6f03a0fe18dfe44abe0ca79b0e35eeee063"}
Aug 04 16:05:41.141794 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:41.141768    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7386-140234341530768" oldPodUID="6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" podUID="71863ad7-9a72-495f-a17d-5dc124f7b6ba"
Aug 04 16:05:42.137301 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:42.137268    2581 generic.go:356] "Generic (PLEG): container finished" podID="71863ad7-9a72-495f-a17d-5dc124f7b6ba" containerID="16446cd40411546c9421ad68de021dbc83150109f2814146df552dc354008cc6" exitCode=0
Aug 04 16:05:42.137721 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:42.137354    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341530768" event={"ID":"71863ad7-9a72-495f-a17d-5dc124f7b6ba","Type":"ContainerDied","Data":"16446cd40411546c9421ad68de021dbc83150109f2814146df552dc354008cc6"}
Aug 04 16:05:42.301978 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:42.301948    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c2a6858-6397-4196-9ade-2ea5e8a9fb6c" path="/var/lib/kubelet/pods/6c2a6858-6397-4196-9ade-2ea5e8a9fb6c/volumes"
Aug 04 16:05:43.273803 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.273767    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:43.296729 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.296669    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7386-140234341530768_71863ad7-9a72-495f-a17d-5dc124f7b6ba/test-curl-7386-140234341530768/0.log"
Aug 04 16:05:43.320173 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.320141    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:43.324229 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.324202    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7386-140234341530768"]
Aug 04 16:05:43.405092 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.405014    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjkkt\" (UniqueName: \"kubernetes.io/projected/71863ad7-9a72-495f-a17d-5dc124f7b6ba-kube-api-access-tjkkt\") pod \"71863ad7-9a72-495f-a17d-5dc124f7b6ba\" (UID: \"71863ad7-9a72-495f-a17d-5dc124f7b6ba\") "
Aug 04 16:05:43.407204 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.407180    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71863ad7-9a72-495f-a17d-5dc124f7b6ba-kube-api-access-tjkkt" (OuterVolumeSpecName: "kube-api-access-tjkkt") pod "71863ad7-9a72-495f-a17d-5dc124f7b6ba" (UID: "71863ad7-9a72-495f-a17d-5dc124f7b6ba"). InnerVolumeSpecName "kube-api-access-tjkkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:43.455663 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.455631    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7386-140234341404720"]
Aug 04 16:05:43.455940 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.455926    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71863ad7-9a72-495f-a17d-5dc124f7b6ba" containerName="test-curl-7386-140234341530768"
Aug 04 16:05:43.456003 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.455941    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="71863ad7-9a72-495f-a17d-5dc124f7b6ba" containerName="test-curl-7386-140234341530768"
Aug 04 16:05:43.456003 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.455994    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="71863ad7-9a72-495f-a17d-5dc124f7b6ba" containerName="test-curl-7386-140234341530768"
Aug 04 16:05:43.458732 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.458717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:43.467506 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.467478    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341404720"]
Aug 04 16:05:43.505770 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.505740    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjkkt\" (UniqueName: \"kubernetes.io/projected/71863ad7-9a72-495f-a17d-5dc124f7b6ba-kube-api-access-tjkkt\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:43.606637 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.606600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mggt\" (UniqueName: \"kubernetes.io/projected/8db497ca-9d50-43a2-bf2b-9a606c5e6664-kube-api-access-8mggt\") pod \"test-curl-7386-140234341404720\" (UID: \"8db497ca-9d50-43a2-bf2b-9a606c5e6664\") " pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:43.707300 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.707207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mggt\" (UniqueName: \"kubernetes.io/projected/8db497ca-9d50-43a2-bf2b-9a606c5e6664-kube-api-access-8mggt\") pod \"test-curl-7386-140234341404720\" (UID: \"8db497ca-9d50-43a2-bf2b-9a606c5e6664\") " pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:43.716420 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.716388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mggt\" (UniqueName: \"kubernetes.io/projected/8db497ca-9d50-43a2-bf2b-9a606c5e6664-kube-api-access-8mggt\") pod \"test-curl-7386-140234341404720\" (UID: \"8db497ca-9d50-43a2-bf2b-9a606c5e6664\") " pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:43.768459 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.768424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:43.905601 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:43.905566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7386-140234341404720"]
Aug 04 16:05:43.908432 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:05:43.908400    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8db497ca_9d50_43a2_bf2b_9a606c5e6664.slice/crio-5cce0e1ab1f9044a6e8123cecb30019e8e194debc7cae96cf9005a9ce9ae1c49 WatchSource:0}: Error finding container 5cce0e1ab1f9044a6e8123cecb30019e8e194debc7cae96cf9005a9ce9ae1c49: Status 404 returned error can't find the container with id 5cce0e1ab1f9044a6e8123cecb30019e8e194debc7cae96cf9005a9ce9ae1c49
Aug 04 16:05:44.147664 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:44.147636    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:44.147826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:44.147680    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="966f7639dbcf42b09d340ab3821ba6f03a0fe18dfe44abe0ca79b0e35eeee063"
Aug 04 16:05:44.148764 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:44.148730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341404720" event={"ID":"8db497ca-9d50-43a2-bf2b-9a606c5e6664","Type":"ContainerStarted","Data":"5cce0e1ab1f9044a6e8123cecb30019e8e194debc7cae96cf9005a9ce9ae1c49"}
Aug 04 16:05:44.158783 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:05:44.158755    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7386-140234341530768\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="71863ad7-9a72-495f-a17d-5dc124f7b6ba" pod="opendatahub/test-curl-7386-140234341530768"
Aug 04 16:05:44.301809 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:44.301779    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71863ad7-9a72-495f-a17d-5dc124f7b6ba" path="/var/lib/kubelet/pods/71863ad7-9a72-495f-a17d-5dc124f7b6ba/volumes"
Aug 04 16:05:45.154574 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:45.154520    2581 generic.go:356] "Generic (PLEG): container finished" podID="8db497ca-9d50-43a2-bf2b-9a606c5e6664" containerID="6e7337bf8c33db147750cbe09392856b019d5b55bdc9b9aa4d6f6e7a7d7b65bc" exitCode=0
Aug 04 16:05:45.154735 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:45.154637    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7386-140234341404720" event={"ID":"8db497ca-9d50-43a2-bf2b-9a606c5e6664","Type":"ContainerDied","Data":"6e7337bf8c33db147750cbe09392856b019d5b55bdc9b9aa4d6f6e7a7d7b65bc"}
Aug 04 16:05:45.702694 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:45.702652    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7" podUID="f59f0312-1884-42ee-a957-78b61369ecd1" containerName="main" containerID="cri-o://c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47" gracePeriod=45
Aug 04 16:05:45.949795 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:45.949767    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:05:46.130423 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-dshm\") pod \"f59f0312-1884-42ee-a957-78b61369ecd1\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") "
Aug 04 16:05:46.130423 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130410    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-tmp-dir\") pod \"f59f0312-1884-42ee-a957-78b61369ecd1\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") "
Aug 04 16:05:46.130683 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-home\") pod \"f59f0312-1884-42ee-a957-78b61369ecd1\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") "
Aug 04 16:05:46.130683 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130472    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfr24\" (UniqueName: \"kubernetes.io/projected/f59f0312-1884-42ee-a957-78b61369ecd1-kube-api-access-tfr24\") pod \"f59f0312-1884-42ee-a957-78b61369ecd1\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") "
Aug 04 16:05:46.130683 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130523    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59f0312-1884-42ee-a957-78b61369ecd1-tls-certs\") pod \"f59f0312-1884-42ee-a957-78b61369ecd1\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") "
Aug 04 16:05:46.130683 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-model-cache\") pod \"f59f0312-1884-42ee-a957-78b61369ecd1\" (UID: \"f59f0312-1884-42ee-a957-78b61369ecd1\") "
Aug 04 16:05:46.130869 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130737    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f59f0312-1884-42ee-a957-78b61369ecd1" (UID: "f59f0312-1884-42ee-a957-78b61369ecd1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:46.130869 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130747    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-home" (OuterVolumeSpecName: "home") pod "f59f0312-1884-42ee-a957-78b61369ecd1" (UID: "f59f0312-1884-42ee-a957-78b61369ecd1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:46.130963 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130911    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-tmp-dir\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:46.130963 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130932    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-home\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:46.131037 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.130956    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-model-cache" (OuterVolumeSpecName: "model-cache") pod "f59f0312-1884-42ee-a957-78b61369ecd1" (UID: "f59f0312-1884-42ee-a957-78b61369ecd1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:46.132759 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.132730    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-dshm" (OuterVolumeSpecName: "dshm") pod "f59f0312-1884-42ee-a957-78b61369ecd1" (UID: "f59f0312-1884-42ee-a957-78b61369ecd1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:05:46.132870 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.132784    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f59f0312-1884-42ee-a957-78b61369ecd1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f59f0312-1884-42ee-a957-78b61369ecd1" (UID: "f59f0312-1884-42ee-a957-78b61369ecd1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:05:46.132870 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.132794    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f59f0312-1884-42ee-a957-78b61369ecd1-kube-api-access-tfr24" (OuterVolumeSpecName: "kube-api-access-tfr24") pod "f59f0312-1884-42ee-a957-78b61369ecd1" (UID: "f59f0312-1884-42ee-a957-78b61369ecd1"). InnerVolumeSpecName "kube-api-access-tfr24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:46.160892 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.160861    2581 generic.go:356] "Generic (PLEG): container finished" podID="f59f0312-1884-42ee-a957-78b61369ecd1" containerID="c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47" exitCode=0
Aug 04 16:05:46.161006 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.160907    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"
Aug 04 16:05:46.161006 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.160948    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7" event={"ID":"f59f0312-1884-42ee-a957-78b61369ecd1","Type":"ContainerDied","Data":"c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47"}
Aug 04 16:05:46.161006 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.160993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7" event={"ID":"f59f0312-1884-42ee-a957-78b61369ecd1","Type":"ContainerDied","Data":"a81360cdf7e41a5f16083b258b8eb86940732f0887cf4aecda485508139d29df"}
Aug 04 16:05:46.161151 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.161013    2581 scope.go:117] "RemoveContainer" containerID="c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47"
Aug 04 16:05:46.170627 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.170606    2581 scope.go:117] "RemoveContainer" containerID="c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47"
Aug 04 16:05:46.170912 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:05:46.170894    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47\": container with ID starting with c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47 not found: ID does not exist" containerID="c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47"
Aug 04 16:05:46.171039 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.170920    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47"} err="failed to get container status \"c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47\": rpc error: code = NotFound desc = could not find container \"c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47\": container with ID starting with c33ddacac0b6a8e42c56dffa54eba518e8a2ea0d8a9c624acfe2ed99ff6b9c47 not found: ID does not exist"
Aug 04 16:05:46.184216 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.184194    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"]
Aug 04 16:05:46.189285 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.189266    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-7b41f3/rate-test-model-7b41f3-kserve-847d8b998c-ft2h7"]
Aug 04 16:05:46.231766 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.231741    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f59f0312-1884-42ee-a957-78b61369ecd1-tls-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:46.231766 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.231764    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-model-cache\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:46.231766 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.231772    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f59f0312-1884-42ee-a957-78b61369ecd1-dshm\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:46.231948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.231780    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfr24\" (UniqueName: \"kubernetes.io/projected/f59f0312-1884-42ee-a957-78b61369ecd1-kube-api-access-tfr24\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:46.287726 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.287698    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:46.301882 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.301860    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f59f0312-1884-42ee-a957-78b61369ecd1" path="/var/lib/kubelet/pods/f59f0312-1884-42ee-a957-78b61369ecd1/volumes"
Aug 04 16:05:46.310246 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.310223    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7386-140234341404720_8db497ca-9d50-43a2-bf2b-9a606c5e6664/test-curl-7386-140234341404720/0.log"
Aug 04 16:05:46.334233 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.334197    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7386-140234341404720"]
Aug 04 16:05:46.340411 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.340377    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7386-140234341404720"]
Aug 04 16:05:46.433157 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.433126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mggt\" (UniqueName: \"kubernetes.io/projected/8db497ca-9d50-43a2-bf2b-9a606c5e6664-kube-api-access-8mggt\") pod \"8db497ca-9d50-43a2-bf2b-9a606c5e6664\" (UID: \"8db497ca-9d50-43a2-bf2b-9a606c5e6664\") "
Aug 04 16:05:46.435342 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.435314    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8db497ca-9d50-43a2-bf2b-9a606c5e6664-kube-api-access-8mggt" (OuterVolumeSpecName: "kube-api-access-8mggt") pod "8db497ca-9d50-43a2-bf2b-9a606c5e6664" (UID: "8db497ca-9d50-43a2-bf2b-9a606c5e6664"). InnerVolumeSpecName "kube-api-access-8mggt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:05:46.534459 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:46.534425    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mggt\" (UniqueName: \"kubernetes.io/projected/8db497ca-9d50-43a2-bf2b-9a606c5e6664-kube-api-access-8mggt\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:05:47.166449 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:47.166420    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:47.166953 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:47.166452    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cce0e1ab1f9044a6e8123cecb30019e8e194debc7cae96cf9005a9ce9ae1c49"
Aug 04 16:05:47.176774 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:05:47.176747    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7386-140234341404720\" is forbidden: User \"system:node:ip-10-0-137-247.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-247.ec2.internal' and this object" podUID="8db497ca-9d50-43a2-bf2b-9a606c5e6664" pod="opendatahub/test-curl-7386-140234341404720"
Aug 04 16:05:48.302338 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:48.302295    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8db497ca-9d50-43a2-bf2b-9a606c5e6664" path="/var/lib/kubelet/pods/8db497ca-9d50-43a2-bf2b-9a606c5e6664/volumes"
Aug 04 16:05:54.643052 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"]
Aug 04 16:05:54.643485 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643470    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f59f0312-1884-42ee-a957-78b61369ecd1" containerName="main"
Aug 04 16:05:54.643552 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643488    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f59f0312-1884-42ee-a957-78b61369ecd1" containerName="main"
Aug 04 16:05:54.643552 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643512    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8db497ca-9d50-43a2-bf2b-9a606c5e6664" containerName="test-curl-7386-140234341404720"
Aug 04 16:05:54.643552 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643521    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8db497ca-9d50-43a2-bf2b-9a606c5e6664" containerName="test-curl-7386-140234341404720"
Aug 04 16:05:54.643651 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643604    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f59f0312-1884-42ee-a957-78b61369ecd1" containerName="main"
Aug 04 16:05:54.643651 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.643617    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8db497ca-9d50-43a2-bf2b-9a606c5e6664" containerName="test-curl-7386-140234341404720"
Aug 04 16:05:54.647073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.647052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.653784 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.653759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-e9e4ac-serving-cert\""
Aug 04 16:05:54.653901 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.653824    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qxjgf\""
Aug 04 16:05:54.655078 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.655057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 16:05:54.655202 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.655089    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 16:05:54.661618 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.661594    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"]
Aug 04 16:05:54.701941 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.701889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b54125b-282e-46d3-a567-91f40a50d544-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.702116 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.701953    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls88m\" (UniqueName: \"kubernetes.io/projected/6b54125b-282e-46d3-a567-91f40a50d544-kube-api-access-ls88m\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.702116 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.702021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b54125b-282e-46d3-a567-91f40a50d544-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.802383 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.802349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b54125b-282e-46d3-a567-91f40a50d544-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.802599 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.802389    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls88m\" (UniqueName: \"kubernetes.io/projected/6b54125b-282e-46d3-a567-91f40a50d544-kube-api-access-ls88m\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.802599 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.802589    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b54125b-282e-46d3-a567-91f40a50d544-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.803175 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.803156    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b54125b-282e-46d3-a567-91f40a50d544-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.804927 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.804909    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b54125b-282e-46d3-a567-91f40a50d544-maas-api-tls\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.811457 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.811436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls88m\" (UniqueName: \"kubernetes.io/projected/6b54125b-282e-46d3-a567-91f40a50d544-kube-api-access-ls88m\") pod \"maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:54.956970 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:54.956876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:55.102077 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:55.102052    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"]
Aug 04 16:05:55.104171 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:05:55.104131    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b54125b_282e_46d3_a567_91f40a50d544.slice/crio-1017d97423858c9fec0d8039833c4ae874c5d28eb25f5633142faac41207acb9 WatchSource:0}: Error finding container 1017d97423858c9fec0d8039833c4ae874c5d28eb25f5633142faac41207acb9: Status 404 returned error can't find the container with id 1017d97423858c9fec0d8039833c4ae874c5d28eb25f5633142faac41207acb9
Aug 04 16:05:55.206515 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:55.206466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd" event={"ID":"6b54125b-282e-46d3-a567-91f40a50d544","Type":"ContainerStarted","Data":"1017d97423858c9fec0d8039833c4ae874c5d28eb25f5633142faac41207acb9"}
Aug 04 16:05:59.228558 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:59.228510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd" event={"ID":"6b54125b-282e-46d3-a567-91f40a50d544","Type":"ContainerStarted","Data":"bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c"}
Aug 04 16:05:59.228944 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:59.228633    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:05:59.269125 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:05:59.269068    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd" podStartSLOduration=1.9363529179999999 podStartE2EDuration="5.269051036s" totalImagesPullingTime="3.332698118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:59.266438604 +0000 UTC m=+3573.481451403" watchObservedRunningTime="2026-08-04 16:05:59.269051036 +0000 UTC m=+3573.484063831"
Aug 04 16:06:05.244479 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:05.244450    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:06:19.553794 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.553706    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"]
Aug 04 16:06:19.557701 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.557676    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.560568 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.560541    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d94d35-openshift-default-dockercfg-9p9kq\""
Aug 04 16:06:19.574277 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.574251    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"]
Aug 04 16:06:19.612308 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-envoy\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612308 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-podinfo\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612628 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-data\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612628 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-certs\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612628 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skg4\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-kube-api-access-5skg4\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612628 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-credential-socket\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612853 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istiod-ca-cert\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612853 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-token\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.612853 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.612736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-socket\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713266 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skg4\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-kube-api-access-5skg4\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713266 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-credential-socket\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713557 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istiod-ca-cert\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713557 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-token\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713557 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713350    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-socket\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713557 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-envoy\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713557 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713408    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-podinfo\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713557 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-data\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713892 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-certs\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713892 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-credential-socket\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.713892 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713840    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-socket\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.714047 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.713980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-data\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.714151 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.714131    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-certs\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.714244 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.714227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istiod-ca-cert\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.716102 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.716077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-podinfo\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.716203 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.716144    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-envoy\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.727158 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.727128    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-token\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.727288 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.727162    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skg4\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-kube-api-access-5skg4\") pod \"e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") " pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:19.874664 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:19.874550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:20.025981 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:20.025954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"]
Aug 04 16:06:20.027910 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:06:20.027882    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ef3b643_1c51_4d95_a66e_1a6a7ea4de51.slice/crio-36ee114c87f49592fb4229cf196aca8204a714810dc24f5f7b9641e36abf6c06 WatchSource:0}: Error finding container 36ee114c87f49592fb4229cf196aca8204a714810dc24f5f7b9641e36abf6c06: Status 404 returned error can't find the container with id 36ee114c87f49592fb4229cf196aca8204a714810dc24f5f7b9641e36abf6c06
Aug 04 16:06:20.327599 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:20.327559    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" event={"ID":"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51","Type":"ContainerStarted","Data":"36ee114c87f49592fb4229cf196aca8204a714810dc24f5f7b9641e36abf6c06"}
Aug 04 16:06:24.774948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:24.774915    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:06:24.775230 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:24.774990    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:06:24.775230 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:24.775019    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:06:25.356978 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:25.356936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" event={"ID":"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51","Type":"ContainerStarted","Data":"b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"}
Aug 04 16:06:25.383730 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:25.383681    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" podStartSLOduration=1.639063785 podStartE2EDuration="6.38366578s" totalImagesPullingTime="4.744601995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:06:25.381225914 +0000 UTC m=+3599.596238709" watchObservedRunningTime="2026-08-04 16:06:25.38366578 +0000 UTC m=+3599.598678575"
Aug 04 16:06:25.875352 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:25.875308    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:25.880586 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:25.880554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:26.361731 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:26.361700    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:26.362640 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:26.362613    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:29.363161 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.363119    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"]
Aug 04 16:06:29.372017 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.371983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.374952 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.374928    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-d94d35-dockercfg-7jx5s\""
Aug 04 16:06:29.375103 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.374982    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d94d35\""
Aug 04 16:06:29.386100 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.386075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"]
Aug 04 16:06:29.409052 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.409015    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"]
Aug 04 16:06:29.412978 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.412960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.423553 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.423505    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"]
Aug 04 16:06:29.509185 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.509150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b5ab72-442e-4e3e-bce9-cc481676f395-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.509364 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.509195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.509364 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.509229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frlsq\" (UniqueName: \"kubernetes.io/projected/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-kube-api-access-frlsq\") pod \"payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.509364 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.509286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gwkk\" (UniqueName: \"kubernetes.io/projected/31b5ab72-442e-4e3e-bce9-cc481676f395-kube-api-access-2gwkk\") pod \"payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.610635 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.610595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frlsq\" (UniqueName: \"kubernetes.io/projected/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-kube-api-access-frlsq\") pod \"payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.610826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.610651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gwkk\" (UniqueName: \"kubernetes.io/projected/31b5ab72-442e-4e3e-bce9-cc481676f395-kube-api-access-2gwkk\") pod \"payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.610826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.610701    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b5ab72-442e-4e3e-bce9-cc481676f395-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.610826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.610731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.611440 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.611415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b5ab72-442e-4e3e-bce9-cc481676f395-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.611522 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.611436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.620693 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.620634    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frlsq\" (UniqueName: \"kubernetes.io/projected/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-kube-api-access-frlsq\") pod \"payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.620693 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.620672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gwkk\" (UniqueName: \"kubernetes.io/projected/31b5ab72-442e-4e3e-bce9-cc481676f395-kube-api-access-2gwkk\") pod \"payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.682741 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.682692    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:29.723889 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.723850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:29.836704 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.836670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"]
Aug 04 16:06:29.839917 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:06:29.839887    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b5ab72_442e_4e3e_bce9_cc481676f395.slice/crio-e66f7dbe1891f96a914e9c1524ad539c3a9f3b952fcd9728485b70e47efdc897 WatchSource:0}: Error finding container e66f7dbe1891f96a914e9c1524ad539c3a9f3b952fcd9728485b70e47efdc897: Status 404 returned error can't find the container with id e66f7dbe1891f96a914e9c1524ad539c3a9f3b952fcd9728485b70e47efdc897
Aug 04 16:06:29.879444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:29.879422    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"]
Aug 04 16:06:29.881101 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:06:29.881068    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fc5ee15_195c_4031_8f58_e7b8edec7dbd.slice/crio-b173cf416d7d4c3f37cc9eec205bef3236c8982b330768761b245fe22ed2aecd WatchSource:0}: Error finding container b173cf416d7d4c3f37cc9eec205bef3236c8982b330768761b245fe22ed2aecd: Status 404 returned error can't find the container with id b173cf416d7d4c3f37cc9eec205bef3236c8982b330768761b245fe22ed2aecd
Aug 04 16:06:30.381239 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:30.381198    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb" event={"ID":"5fc5ee15-195c-4031-8f58-e7b8edec7dbd","Type":"ContainerStarted","Data":"b173cf416d7d4c3f37cc9eec205bef3236c8982b330768761b245fe22ed2aecd"}
Aug 04 16:06:30.382355 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:30.382329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k" event={"ID":"31b5ab72-442e-4e3e-bce9-cc481676f395","Type":"ContainerStarted","Data":"e66f7dbe1891f96a914e9c1524ad539c3a9f3b952fcd9728485b70e47efdc897"}
Aug 04 16:06:32.401011 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:32.400961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k" event={"ID":"31b5ab72-442e-4e3e-bce9-cc481676f395","Type":"ContainerStarted","Data":"045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa"}
Aug 04 16:06:32.401567 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:32.401079    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:32.402457 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:32.402426    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb" event={"ID":"5fc5ee15-195c-4031-8f58-e7b8edec7dbd","Type":"ContainerStarted","Data":"a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77"}
Aug 04 16:06:32.402606 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:32.402558    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:32.419976 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:32.419923    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k" podStartSLOduration=1.646586869 podStartE2EDuration="3.419907539s" totalImagesPullingTime="1.77332067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:06:32.418675251 +0000 UTC m=+3606.633688060" watchObservedRunningTime="2026-08-04 16:06:32.419907539 +0000 UTC m=+3606.634920365"
Aug 04 16:06:32.436770 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:32.436708    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb" podStartSLOduration=1.704692003 podStartE2EDuration="3.436689584s" totalImagesPullingTime="1.731997581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:06:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:06:32.436279544 +0000 UTC m=+3606.651292337" watchObservedRunningTime="2026-08-04 16:06:32.436689584 +0000 UTC m=+3606.651702384"
Aug 04 16:06:43.409300 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:43.409267    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:06:43.409736 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:43.409355    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:06:44.459948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:44.459864    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerID="b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0" exitCode=0
Aug 04 16:06:44.459948 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:44.459929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" event={"ID":"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51","Type":"ContainerDied","Data":"b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"}
Aug 04 16:06:44.460385 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:44.460367    2581 scope.go:117] "RemoveContainer" containerID="b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"
Aug 04 16:06:44.461523 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:44.461484    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:06:44.461634 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:44.461616    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:06:44.461682 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:44.461662    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:06:45.470165 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:45.470122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" event={"ID":"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51","Type":"ContainerStarted","Data":"c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45"}
Aug 04 16:06:45.875708 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:45.875605    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:45.875868 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:45.875794    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:06:45.875913 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:45.875856    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Aug 04 16:06:46.875666 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:46.875615    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:06:46.876182 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:46.875693    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Aug 04 16:06:47.875422 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:47.875377    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:06:47.875773 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:47.875738    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Aug 04 16:06:48.875912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:48.875865    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Aug 04 16:06:48.876413 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:48.875938    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Aug 04 16:06:49.878762 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:49.878730    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:49.879125 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:49.879018    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:49.879689 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:49.879656    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:06:59.498809 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:06:59.498774    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k_31b5ab72-442e-4e3e-bce9-cc481676f395/payload-processing/0.log"
Aug 04 16:07:54.878973 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:54.878903    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k_31b5ab72-442e-4e3e-bce9-cc481676f395/payload-processing/0.log"
Aug 04 16:07:55.485518 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.485483    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"]
Aug 04 16:07:55.488941 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.488921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.494696 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.494673    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-cc2056-openshift-default-dockercfg-bcpwx\""
Aug 04 16:07:55.508971 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.508945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"]
Aug 04 16:07:55.544994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.544950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-envoy\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545183 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5cd\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-kube-api-access-qx5cd\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545183 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-podinfo\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545183 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545183 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545092    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-data\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545183 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-token\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545440 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-certs\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545440 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-credential-socket\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.545440 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.545302    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-socket\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646321 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-credential-socket\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646321 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-socket\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-envoy\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646399    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5cd\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-kube-api-access-qx5cd\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646438    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-podinfo\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646472    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-data\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-token\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.646622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646595    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-certs\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.647031 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-credential-socket\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.647031 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.646897    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-socket\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.647031 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.647021    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-certs\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.647164 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.647045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-data\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.647405 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.647387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istiod-ca-cert\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.649050 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.649029    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-envoy\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.649376 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.649360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-podinfo\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.663477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.663446    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-token\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.663934 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.663913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5cd\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-kube-api-access-qx5cd\") pod \"e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") " pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.798752 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.798653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:55.958605 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.958558    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"]
Aug 04 16:07:55.961693 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:07:55.961659    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc4e919e_d818_415f_b8eb_0a3ffd6b48db.slice/crio-9d7aaaa9eb755cdaf34ce4607c706e113a2a0823e477538e93b33f6ec05b5a3d WatchSource:0}: Error finding container 9d7aaaa9eb755cdaf34ce4607c706e113a2a0823e477538e93b33f6ec05b5a3d: Status 404 returned error can't find the container with id 9d7aaaa9eb755cdaf34ce4607c706e113a2a0823e477538e93b33f6ec05b5a3d
Aug 04 16:07:55.963950 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.963916    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:07:55.964073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.964000    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:07:55.964073 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:55.964047    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:07:56.813446 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:56.813411    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" event={"ID":"fc4e919e-d818-415f-b8eb-0a3ffd6b48db","Type":"ContainerStarted","Data":"0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"}
Aug 04 16:07:56.813682 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:56.813463    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" event={"ID":"fc4e919e-d818-415f-b8eb-0a3ffd6b48db","Type":"ContainerStarted","Data":"9d7aaaa9eb755cdaf34ce4607c706e113a2a0823e477538e93b33f6ec05b5a3d"}
Aug 04 16:07:56.838770 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:56.838724    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podStartSLOduration=1.83870705 podStartE2EDuration="1.83870705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:07:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:07:56.838128977 +0000 UTC m=+3691.053141773" watchObservedRunningTime="2026-08-04 16:07:56.83870705 +0000 UTC m=+3691.053719845"
Aug 04 16:07:57.799193 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:57.799161    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:57.804201 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:57.804176    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:57.817885 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:57.817856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:57.818724 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:57.818708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:07:59.915150 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.915107    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"]
Aug 04 16:07:59.918667 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.918643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:07:59.922232 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.922208    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-cc2056-serving-cert\""
Aug 04 16:07:59.937359 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.937326    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"]
Aug 04 16:07:59.986367 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.986336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mxgh\" (UniqueName: \"kubernetes.io/projected/747c5904-3aed-4bd9-93e4-80ac302159da-kube-api-access-9mxgh\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:07:59.986571 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.986388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:07:59.986571 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:07:59.986444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747c5904-3aed-4bd9-93e4-80ac302159da-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.087765 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.087727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.087944 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.087773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747c5904-3aed-4bd9-93e4-80ac302159da-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.087944 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.087856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mxgh\" (UniqueName: \"kubernetes.io/projected/747c5904-3aed-4bd9-93e4-80ac302159da-kube-api-access-9mxgh\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.087944 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:08:00.087903    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-serving-cert: secret "maas-api-e2e-ipp-cleanup-cc2056-serving-cert" not found
Aug 04 16:08:00.088138 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:08:00.087980    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls podName:747c5904-3aed-4bd9-93e4-80ac302159da nodeName:}" failed. No retries permitted until 2026-08-04 16:08:00.587963483 +0000 UTC m=+3694.802976256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" (UID: "747c5904-3aed-4bd9-93e4-80ac302159da") : secret "maas-api-e2e-ipp-cleanup-cc2056-serving-cert" not found
Aug 04 16:08:00.088619 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.088595    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747c5904-3aed-4bd9-93e4-80ac302159da-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.099120 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.099096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mxgh\" (UniqueName: \"kubernetes.io/projected/747c5904-3aed-4bd9-93e4-80ac302159da-kube-api-access-9mxgh\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.592579 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.592541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.595200 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.595176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.829344 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.829307    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:00.908897 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.908862    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"]
Aug 04 16:08:00.913802 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.913642    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:00.917163 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.917138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-cc2056-dockercfg-nrrj9\""
Aug 04 16:08:00.917484 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.917138    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-cc2056\""
Aug 04 16:08:00.922356 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.922332    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"]
Aug 04 16:08:00.997034 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.996998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62hvx\" (UniqueName: \"kubernetes.io/projected/a2c364a9-85ee-49d0-85a3-afb409511849-kube-api-access-62hvx\") pod \"payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:00.997316 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.997109    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c364a9-85ee-49d0-85a3-afb409511849-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:00.999413 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:00.999390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"]
Aug 04 16:08:01.002524 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:08:01.002500    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747c5904_3aed_4bd9_93e4_80ac302159da.slice/crio-19fe172b35dc07e7084be672b5d4a9cdbfc9c8cba15979f100c8d782d604c940 WatchSource:0}: Error finding container 19fe172b35dc07e7084be672b5d4a9cdbfc9c8cba15979f100c8d782d604c940: Status 404 returned error can't find the container with id 19fe172b35dc07e7084be672b5d4a9cdbfc9c8cba15979f100c8d782d604c940
Aug 04 16:08:01.097584 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.097522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c364a9-85ee-49d0-85a3-afb409511849-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:01.097771 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.097611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62hvx\" (UniqueName: \"kubernetes.io/projected/a2c364a9-85ee-49d0-85a3-afb409511849-kube-api-access-62hvx\") pod \"payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:01.098331 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.098309    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c364a9-85ee-49d0-85a3-afb409511849-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:01.107111 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.107074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62hvx\" (UniqueName: \"kubernetes.io/projected/a2c364a9-85ee-49d0-85a3-afb409511849-kube-api-access-62hvx\") pod \"payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:01.224744 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.224641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:01.371579 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.371551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"]
Aug 04 16:08:01.373562 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:08:01.373520    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c364a9_85ee_49d0_85a3_afb409511849.slice/crio-7fcebb14938001d7b2b0287794823f1e8916b0492eb8095c8c673f02c6abc67e WatchSource:0}: Error finding container 7fcebb14938001d7b2b0287794823f1e8916b0492eb8095c8c673f02c6abc67e: Status 404 returned error can't find the container with id 7fcebb14938001d7b2b0287794823f1e8916b0492eb8095c8c673f02c6abc67e
Aug 04 16:08:01.837787 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.837747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4" event={"ID":"a2c364a9-85ee-49d0-85a3-afb409511849","Type":"ContainerStarted","Data":"a2e68672005615e6748e3b1e95a9b0fd12ce05c366dd67a02977ecb55f0e0533"}
Aug 04 16:08:01.837995 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.837804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4" event={"ID":"a2c364a9-85ee-49d0-85a3-afb409511849","Type":"ContainerStarted","Data":"7fcebb14938001d7b2b0287794823f1e8916b0492eb8095c8c673f02c6abc67e"}
Aug 04 16:08:01.837995 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.837853    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:01.839149 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.839124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" event={"ID":"747c5904-3aed-4bd9-93e4-80ac302159da","Type":"ContainerStarted","Data":"19fe172b35dc07e7084be672b5d4a9cdbfc9c8cba15979f100c8d782d604c940"}
Aug 04 16:08:01.858872 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:01.858806    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4" podStartSLOduration=1.858784309 podStartE2EDuration="1.858784309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:01.857211427 +0000 UTC m=+3696.072224225" watchObservedRunningTime="2026-08-04 16:08:01.858784309 +0000 UTC m=+3696.073797083"
Aug 04 16:08:02.845267 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:02.845221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" event={"ID":"747c5904-3aed-4bd9-93e4-80ac302159da","Type":"ContainerStarted","Data":"61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07"}
Aug 04 16:08:02.845759 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:02.845472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:02.865834 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:02.865767    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" podStartSLOduration=2.907356895 podStartE2EDuration="3.865751699s" totalImagesPullingTime="958.394804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:07:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:02.864428108 +0000 UTC m=+3697.079440903" watchObservedRunningTime="2026-08-04 16:08:02.865751699 +0000 UTC m=+3697.080764494"
Aug 04 16:08:08.862967 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:08.862932    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:12.819277 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.819234    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 16:08:12.819786 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.819307    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 16:08:12.847587 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.847554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:12.904366 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.904334    2581 generic.go:356] "Generic (PLEG): container finished" podID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerID="0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a" exitCode=0
Aug 04 16:08:12.904556 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.904394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" event={"ID":"fc4e919e-d818-415f-b8eb-0a3ffd6b48db","Type":"ContainerDied","Data":"0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"}
Aug 04 16:08:12.904812 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.904795    2581 scope.go:117] "RemoveContainer" containerID="0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"
Aug 04 16:08:12.905992 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.905967    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:08:12.906062 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.906046    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:08:12.906103 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:12.906076    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"}
Aug 04 16:08:13.910612 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:13.910576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" event={"ID":"fc4e919e-d818-415f-b8eb-0a3ffd6b48db","Type":"ContainerStarted","Data":"d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a"}
Aug 04 16:08:14.799220 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:14.799178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:08:14.799406 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:14.799387    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 16:08:14.799462 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:14.799437    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 16:08:15.799867 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:15.799828    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 16:08:15.800268 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:15.799892    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 16:08:16.799392 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:16.799348    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 16:08:16.799601 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:16.799421    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 16:08:17.799164 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:17.799121    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Aug 04 16:08:17.799677 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:17.799186    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Aug 04 16:08:18.803782 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:18.803749    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:08:18.804143 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:18.804080    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:08:18.804778 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:18.804765    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:08:24.554450 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.554400    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"]
Aug 04 16:08:24.558451 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.558427    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:24.563305 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.563286    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 16:08:24.567564 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.567521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"]
Aug 04 16:08:24.724704 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.724667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f769cf6-bdcd-437f-809d-875599d4403c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx\" (UID: \"9f769cf6-bdcd-437f-809d-875599d4403c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:24.826045 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.825946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f769cf6-bdcd-437f-809d-875599d4403c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx\" (UID: \"9f769cf6-bdcd-437f-809d-875599d4403c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:24.826673 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.826649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f769cf6-bdcd-437f-809d-875599d4403c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx\" (UID: \"9f769cf6-bdcd-437f-809d-875599d4403c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:24.870251 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:24.870202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:25.017756 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:25.017671    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"]
Aug 04 16:08:25.020075 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:08:25.020036    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f769cf6_bdcd_437f_809d_875599d4403c.slice/crio-c3fda4b0479b026571d55811c11087389bf82b278e34c634248509b3d095d27c WatchSource:0}: Error finding container c3fda4b0479b026571d55811c11087389bf82b278e34c634248509b3d095d27c: Status 404 returned error can't find the container with id c3fda4b0479b026571d55811c11087389bf82b278e34c634248509b3d095d27c
Aug 04 16:08:25.973619 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:25.973577    2581 generic.go:356] "Generic (PLEG): container finished" podID="9f769cf6-bdcd-437f-809d-875599d4403c" containerID="985ffb769ccb24933653ac80218e8fa650db0e299f00019aa5c7932ebbde00a0" exitCode=0
Aug 04 16:08:25.974006 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:25.973638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx" event={"ID":"9f769cf6-bdcd-437f-809d-875599d4403c","Type":"ContainerDied","Data":"985ffb769ccb24933653ac80218e8fa650db0e299f00019aa5c7932ebbde00a0"}
Aug 04 16:08:25.974006 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:25.973711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx" event={"ID":"9f769cf6-bdcd-437f-809d-875599d4403c","Type":"ContainerStarted","Data":"c3fda4b0479b026571d55811c11087389bf82b278e34c634248509b3d095d27c"}
Aug 04 16:08:27.113065 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.113036    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:27.247346 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.247247    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f769cf6-bdcd-437f-809d-875599d4403c-maas-api-service-ca\") pod \"9f769cf6-bdcd-437f-809d-875599d4403c\" (UID: \"9f769cf6-bdcd-437f-809d-875599d4403c\") "
Aug 04 16:08:27.247660 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.247636    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f769cf6-bdcd-437f-809d-875599d4403c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f769cf6-bdcd-437f-809d-875599d4403c" (UID: "9f769cf6-bdcd-437f-809d-875599d4403c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:27.348526 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.348487    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f769cf6-bdcd-437f-809d-875599d4403c-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:27.984686 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.984657    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"
Aug 04 16:08:27.984686 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.984651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx" event={"ID":"9f769cf6-bdcd-437f-809d-875599d4403c","Type":"ContainerDied","Data":"c3fda4b0479b026571d55811c11087389bf82b278e34c634248509b3d095d27c"}
Aug 04 16:08:27.984980 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:27.984714    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3fda4b0479b026571d55811c11087389bf82b278e34c634248509b3d095d27c"
Aug 04 16:08:30.578907 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.578870    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"]
Aug 04 16:08:30.579782 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.579725    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" podUID="747c5904-3aed-4bd9-93e4-80ac302159da" containerName="maas-api" containerID="cri-o://61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07" gracePeriod=30
Aug 04 16:08:30.733149 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.733113    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"]
Aug 04 16:08:30.733358 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.733335    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4" podUID="a2c364a9-85ee-49d0-85a3-afb409511849" containerName="payload-processing" containerID="cri-o://a2e68672005615e6748e3b1e95a9b0fd12ce05c366dd67a02977ecb55f0e0533" gracePeriod=30
Aug 04 16:08:30.880475 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.880435    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:30.982115 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.982082    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mxgh\" (UniqueName: \"kubernetes.io/projected/747c5904-3aed-4bd9-93e4-80ac302159da-kube-api-access-9mxgh\") pod \"747c5904-3aed-4bd9-93e4-80ac302159da\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") "
Aug 04 16:08:30.982308 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.982151    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747c5904-3aed-4bd9-93e4-80ac302159da-openshift-service-ca\") pod \"747c5904-3aed-4bd9-93e4-80ac302159da\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") "
Aug 04 16:08:30.982308 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.982191    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls\") pod \"747c5904-3aed-4bd9-93e4-80ac302159da\" (UID: \"747c5904-3aed-4bd9-93e4-80ac302159da\") "
Aug 04 16:08:30.982618 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.982585    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/747c5904-3aed-4bd9-93e4-80ac302159da-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "747c5904-3aed-4bd9-93e4-80ac302159da" (UID: "747c5904-3aed-4bd9-93e4-80ac302159da"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:30.984736 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.984702    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "747c5904-3aed-4bd9-93e4-80ac302159da" (UID: "747c5904-3aed-4bd9-93e4-80ac302159da"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:08:30.985056 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.985033    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/747c5904-3aed-4bd9-93e4-80ac302159da-kube-api-access-9mxgh" (OuterVolumeSpecName: "kube-api-access-9mxgh") pod "747c5904-3aed-4bd9-93e4-80ac302159da" (UID: "747c5904-3aed-4bd9-93e4-80ac302159da"). InnerVolumeSpecName "kube-api-access-9mxgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:31.000021 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:30.999997    2581 generic.go:356] "Generic (PLEG): container finished" podID="a2c364a9-85ee-49d0-85a3-afb409511849" containerID="a2e68672005615e6748e3b1e95a9b0fd12ce05c366dd67a02977ecb55f0e0533" exitCode=0
Aug 04 16:08:31.000126 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.000065    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4" event={"ID":"a2c364a9-85ee-49d0-85a3-afb409511849","Type":"ContainerDied","Data":"a2e68672005615e6748e3b1e95a9b0fd12ce05c366dd67a02977ecb55f0e0533"}
Aug 04 16:08:31.001632 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.001602    2581 generic.go:356] "Generic (PLEG): container finished" podID="747c5904-3aed-4bd9-93e4-80ac302159da" containerID="61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07" exitCode=0
Aug 04 16:08:31.001734 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.001630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" event={"ID":"747c5904-3aed-4bd9-93e4-80ac302159da","Type":"ContainerDied","Data":"61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07"}
Aug 04 16:08:31.001734 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.001683    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p" event={"ID":"747c5904-3aed-4bd9-93e4-80ac302159da","Type":"ContainerDied","Data":"19fe172b35dc07e7084be672b5d4a9cdbfc9c8cba15979f100c8d782d604c940"}
Aug 04 16:08:31.001734 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.001687    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"
Aug 04 16:08:31.002071 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.001712    2581 scope.go:117] "RemoveContainer" containerID="61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07"
Aug 04 16:08:31.004372 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.004352    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:31.006332 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.006307    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"]
Aug 04 16:08:31.012744 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.012722    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cc2056-vsdlx"]
Aug 04 16:08:31.013443 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.013423    2581 scope.go:117] "RemoveContainer" containerID="61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07"
Aug 04 16:08:31.013780 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:08:31.013756    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07\": container with ID starting with 61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07 not found: ID does not exist" containerID="61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07"
Aug 04 16:08:31.013848 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.013787    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07"} err="failed to get container status \"61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07\": rpc error: code = NotFound desc = could not find container \"61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07\": container with ID starting with 61018b05e3b105f20a33ef28ae61d7464aba8484211d21e41e2f73a4bf5dac07 not found: ID does not exist"
Aug 04 16:08:31.067724 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.067693    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"]
Aug 04 16:08:31.077713 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.077680    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-cc2056-795c6c898c-jnv5p"]
Aug 04 16:08:31.082783 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.082761    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/747c5904-3aed-4bd9-93e4-80ac302159da-openshift-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.082858 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.082786    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/747c5904-3aed-4bd9-93e4-80ac302159da-maas-api-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.082858 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.082798    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mxgh\" (UniqueName: \"kubernetes.io/projected/747c5904-3aed-4bd9-93e4-80ac302159da-kube-api-access-9mxgh\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.183345 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.183308    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c364a9-85ee-49d0-85a3-afb409511849-plugins-config-volume\") pod \"a2c364a9-85ee-49d0-85a3-afb409511849\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") "
Aug 04 16:08:31.183608 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.183402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62hvx\" (UniqueName: \"kubernetes.io/projected/a2c364a9-85ee-49d0-85a3-afb409511849-kube-api-access-62hvx\") pod \"a2c364a9-85ee-49d0-85a3-afb409511849\" (UID: \"a2c364a9-85ee-49d0-85a3-afb409511849\") "
Aug 04 16:08:31.183835 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.183809    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2c364a9-85ee-49d0-85a3-afb409511849-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a2c364a9-85ee-49d0-85a3-afb409511849" (UID: "a2c364a9-85ee-49d0-85a3-afb409511849"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:31.185874 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.185846    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c364a9-85ee-49d0-85a3-afb409511849-kube-api-access-62hvx" (OuterVolumeSpecName: "kube-api-access-62hvx") pod "a2c364a9-85ee-49d0-85a3-afb409511849" (UID: "a2c364a9-85ee-49d0-85a3-afb409511849"). InnerVolumeSpecName "kube-api-access-62hvx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:31.284857 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.284820    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62hvx\" (UniqueName: \"kubernetes.io/projected/a2c364a9-85ee-49d0-85a3-afb409511849-kube-api-access-62hvx\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.284857 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:31.284850    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a2c364a9-85ee-49d0-85a3-afb409511849-plugins-config-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:32.007609 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.007576    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"
Aug 04 16:08:32.008048 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.007577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4" event={"ID":"a2c364a9-85ee-49d0-85a3-afb409511849","Type":"ContainerDied","Data":"7fcebb14938001d7b2b0287794823f1e8916b0492eb8095c8c673f02c6abc67e"}
Aug 04 16:08:32.008048 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.007717    2581 scope.go:117] "RemoveContainer" containerID="a2e68672005615e6748e3b1e95a9b0fd12ce05c366dd67a02977ecb55f0e0533"
Aug 04 16:08:32.032039 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.032010    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"]
Aug 04 16:08:32.036478 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.036447    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cc2056-dd647dd9d-v5hg4"]
Aug 04 16:08:32.302597 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.302500    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="747c5904-3aed-4bd9-93e4-80ac302159da" path="/var/lib/kubelet/pods/747c5904-3aed-4bd9-93e4-80ac302159da/volumes"
Aug 04 16:08:32.302932 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.302917    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f769cf6-bdcd-437f-809d-875599d4403c" path="/var/lib/kubelet/pods/9f769cf6-bdcd-437f-809d-875599d4403c/volumes"
Aug 04 16:08:32.303219 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:32.303208    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2c364a9-85ee-49d0-85a3-afb409511849" path="/var/lib/kubelet/pods/a2c364a9-85ee-49d0-85a3-afb409511849/volumes"
Aug 04 16:08:38.010358 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:38.010316    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"]
Aug 04 16:08:38.010867 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:38.010559    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy" containerID="cri-o://d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a" gracePeriod=30
Aug 04 16:08:41.804984 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.804947    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"]
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805294    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="747c5904-3aed-4bd9-93e4-80ac302159da" containerName="maas-api"
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805309    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="747c5904-3aed-4bd9-93e4-80ac302159da" containerName="maas-api"
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805319    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f769cf6-bdcd-437f-809d-875599d4403c" containerName="revoke-keys"
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805328    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f769cf6-bdcd-437f-809d-875599d4403c" containerName="revoke-keys"
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805349    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c364a9-85ee-49d0-85a3-afb409511849" containerName="payload-processing"
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805355    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c364a9-85ee-49d0-85a3-afb409511849" containerName="payload-processing"
Aug 04 16:08:41.805415 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805406    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="747c5904-3aed-4bd9-93e4-80ac302159da" containerName="maas-api"
Aug 04 16:08:41.805681 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805421    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f769cf6-bdcd-437f-809d-875599d4403c" containerName="revoke-keys"
Aug 04 16:08:41.805681 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.805429    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2c364a9-85ee-49d0-85a3-afb409511849" containerName="payload-processing"
Aug 04 16:08:41.808334 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.808317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:41.811330 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.811303    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 16:08:41.816218 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.816195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"]
Aug 04 16:08:41.870267 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.870228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35d6fbdd-3965-45fd-9233-e4c40cbbd67b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94\" (UID: \"35d6fbdd-3965-45fd-9233-e4c40cbbd67b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:41.971247 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.971209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35d6fbdd-3965-45fd-9233-e4c40cbbd67b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94\" (UID: \"35d6fbdd-3965-45fd-9233-e4c40cbbd67b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:41.971881 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:41.971846    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35d6fbdd-3965-45fd-9233-e4c40cbbd67b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94\" (UID: \"35d6fbdd-3965-45fd-9233-e4c40cbbd67b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:42.119495 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:42.119408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:42.253104 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:42.253069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"]
Aug 04 16:08:42.260597 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:08:42.260562    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d6fbdd_3965_45fd_9233_e4c40cbbd67b.slice/crio-c0ede9077658c49e91799344c701a7a204cc8ae3c52cf743de383f97660ff7e9 WatchSource:0}: Error finding container c0ede9077658c49e91799344c701a7a204cc8ae3c52cf743de383f97660ff7e9: Status 404 returned error can't find the container with id c0ede9077658c49e91799344c701a7a204cc8ae3c52cf743de383f97660ff7e9
Aug 04 16:08:43.062783 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.062742    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94" event={"ID":"35d6fbdd-3965-45fd-9233-e4c40cbbd67b","Type":"ContainerStarted","Data":"8df9e281f2454ffe72d90e148638441db3b03993168a609d71c65cf8955731bd"}
Aug 04 16:08:43.063297 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.062807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94" event={"ID":"35d6fbdd-3965-45fd-9233-e4c40cbbd67b","Type":"ContainerStarted","Data":"c0ede9077658c49e91799344c701a7a204cc8ae3c52cf743de383f97660ff7e9"}
Aug 04 16:08:43.081004 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.080942    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94" podStartSLOduration=2.080925069 podStartE2EDuration="2.080925069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:43.07995299 +0000 UTC m=+3737.294965786" watchObservedRunningTime="2026-08-04 16:08:43.080925069 +0000 UTC m=+3737.295937929"
Aug 04 16:08:43.255280 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.255246    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:08:43.284677 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284596    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-data\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284677 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istiod-ca-cert\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284715    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-certs\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284738    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-podinfo\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-socket\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284770    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-envoy\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284843    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-credential-socket\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284868    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-token\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.284912 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.284894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx5cd\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-kube-api-access-qx5cd\") pod \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\" (UID: \"fc4e919e-d818-415f-b8eb-0a3ffd6b48db\") "
Aug 04 16:08:43.285269 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.285172    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:43.285269 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.285093    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:43.285431 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.285407    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:43.285731 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.285706    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:43.285987 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.285776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:43.287288 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.287264    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:08:43.287441 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.287419    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:43.287704 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.287679    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-kube-api-access-qx5cd" (OuterVolumeSpecName: "kube-api-access-qx5cd") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "kube-api-access-qx5cd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:43.287704 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.287686    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc4e919e-d818-415f-b8eb-0a3ffd6b48db" (UID: "fc4e919e-d818-415f-b8eb-0a3ffd6b48db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:08:43.386015 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.385956    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386015 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386009    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386015 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386023    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386015 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386036    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386313 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386049    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386313 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386061    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386313 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386072    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386313 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386085    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx5cd\" (UniqueName: \"kubernetes.io/projected/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-kube-api-access-qx5cd\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:43.386313 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:43.386099    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc4e919e-d818-415f-b8eb-0a3ffd6b48db-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:44.069050 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.069013    2581 generic.go:356] "Generic (PLEG): container finished" podID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerID="d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a" exitCode=0
Aug 04 16:08:44.069549 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.069087    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"
Aug 04 16:08:44.069549 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.069104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" event={"ID":"fc4e919e-d818-415f-b8eb-0a3ffd6b48db","Type":"ContainerDied","Data":"d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a"}
Aug 04 16:08:44.069549 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.069175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl" event={"ID":"fc4e919e-d818-415f-b8eb-0a3ffd6b48db","Type":"ContainerDied","Data":"9d7aaaa9eb755cdaf34ce4607c706e113a2a0823e477538e93b33f6ec05b5a3d"}
Aug 04 16:08:44.069549 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.069215    2581 scope.go:117] "RemoveContainer" containerID="d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a"
Aug 04 16:08:44.070714 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.070687    2581 generic.go:356] "Generic (PLEG): container finished" podID="35d6fbdd-3965-45fd-9233-e4c40cbbd67b" containerID="8df9e281f2454ffe72d90e148638441db3b03993168a609d71c65cf8955731bd" exitCode=0
Aug 04 16:08:44.070821 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.070777    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94" event={"ID":"35d6fbdd-3965-45fd-9233-e4c40cbbd67b","Type":"ContainerDied","Data":"8df9e281f2454ffe72d90e148638441db3b03993168a609d71c65cf8955731bd"}
Aug 04 16:08:44.079254 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.079234    2581 scope.go:117] "RemoveContainer" containerID="0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"
Aug 04 16:08:44.087886 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.087864    2581 scope.go:117] "RemoveContainer" containerID="d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a"
Aug 04 16:08:44.088186 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:08:44.088168    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a\": container with ID starting with d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a not found: ID does not exist" containerID="d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a"
Aug 04 16:08:44.088231 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.088194    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a"} err="failed to get container status \"d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a\": rpc error: code = NotFound desc = could not find container \"d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a\": container with ID starting with d82bf0155a9d1c96011c1ce5727ab288741f2fb7fe8b47f08eeb6a9d7be5656a not found: ID does not exist"
Aug 04 16:08:44.088231 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.088211    2581 scope.go:117] "RemoveContainer" containerID="0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"
Aug 04 16:08:44.088435 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:08:44.088419    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a\": container with ID starting with 0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a not found: ID does not exist" containerID="0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"
Aug 04 16:08:44.088482 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.088437    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a"} err="failed to get container status \"0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a\": rpc error: code = NotFound desc = could not find container \"0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a\": container with ID starting with 0f2b2e559a97e125ffb425082166bc998dc43f2f857b6c3d92b0169acf9c1e0a not found: ID does not exist"
Aug 04 16:08:44.112021 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.111988    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"]
Aug 04 16:08:44.119034 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.119005    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-cc2056-openshift-default-7f69bf495d-fgkfl"]
Aug 04 16:08:44.301883 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:44.301848    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" path="/var/lib/kubelet/pods/fc4e919e-d818-415f-b8eb-0a3ffd6b48db/volumes"
Aug 04 16:08:45.209596 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:45.209571    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:45.301741 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:45.301709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35d6fbdd-3965-45fd-9233-e4c40cbbd67b-maas-api-service-ca\") pod \"35d6fbdd-3965-45fd-9233-e4c40cbbd67b\" (UID: \"35d6fbdd-3965-45fd-9233-e4c40cbbd67b\") "
Aug 04 16:08:45.302107 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:45.302080    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35d6fbdd-3965-45fd-9233-e4c40cbbd67b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35d6fbdd-3965-45fd-9233-e4c40cbbd67b" (UID: "35d6fbdd-3965-45fd-9233-e4c40cbbd67b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:45.403323 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:45.403281    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35d6fbdd-3965-45fd-9233-e4c40cbbd67b-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:46.083213 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:46.083173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94" event={"ID":"35d6fbdd-3965-45fd-9233-e4c40cbbd67b","Type":"ContainerDied","Data":"c0ede9077658c49e91799344c701a7a204cc8ae3c52cf743de383f97660ff7e9"}
Aug 04 16:08:46.083213 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:46.083192    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"
Aug 04 16:08:46.083213 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:46.083221    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0ede9077658c49e91799344c701a7a204cc8ae3c52cf743de383f97660ff7e9"
Aug 04 16:08:57.461646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.461608    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"]
Aug 04 16:08:57.462172 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.461869    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd" podUID="6b54125b-282e-46d3-a567-91f40a50d544" containerName="maas-api" containerID="cri-o://bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c" gracePeriod=30
Aug 04 16:08:57.716827 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.716735    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:08:57.730477 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.730425    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"]
Aug 04 16:08:57.736770 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.736742    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-e9e4ac-dkt94"]
Aug 04 16:08:57.811260 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.811227    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls88m\" (UniqueName: \"kubernetes.io/projected/6b54125b-282e-46d3-a567-91f40a50d544-kube-api-access-ls88m\") pod \"6b54125b-282e-46d3-a567-91f40a50d544\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") "
Aug 04 16:08:57.811465 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.811319    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b54125b-282e-46d3-a567-91f40a50d544-openshift-service-ca\") pod \"6b54125b-282e-46d3-a567-91f40a50d544\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") "
Aug 04 16:08:57.811465 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.811345    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b54125b-282e-46d3-a567-91f40a50d544-maas-api-tls\") pod \"6b54125b-282e-46d3-a567-91f40a50d544\" (UID: \"6b54125b-282e-46d3-a567-91f40a50d544\") "
Aug 04 16:08:57.811720 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.811700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b54125b-282e-46d3-a567-91f40a50d544-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b54125b-282e-46d3-a567-91f40a50d544" (UID: "6b54125b-282e-46d3-a567-91f40a50d544"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:57.813578 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.813555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b54125b-282e-46d3-a567-91f40a50d544-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b54125b-282e-46d3-a567-91f40a50d544" (UID: "6b54125b-282e-46d3-a567-91f40a50d544"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:08:57.813744 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.813722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b54125b-282e-46d3-a567-91f40a50d544-kube-api-access-ls88m" (OuterVolumeSpecName: "kube-api-access-ls88m") pod "6b54125b-282e-46d3-a567-91f40a50d544" (UID: "6b54125b-282e-46d3-a567-91f40a50d544"). InnerVolumeSpecName "kube-api-access-ls88m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:57.912162 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.912122    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls88m\" (UniqueName: \"kubernetes.io/projected/6b54125b-282e-46d3-a567-91f40a50d544-kube-api-access-ls88m\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:57.912162 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.912154    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b54125b-282e-46d3-a567-91f40a50d544-openshift-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:57.912162 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:57.912164    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b54125b-282e-46d3-a567-91f40a50d544-maas-api-tls\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:08:58.142607 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.142573    2581 generic.go:356] "Generic (PLEG): container finished" podID="6b54125b-282e-46d3-a567-91f40a50d544" containerID="bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c" exitCode=0
Aug 04 16:08:58.142789 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.142618    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"
Aug 04 16:08:58.142789 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.142660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd" event={"ID":"6b54125b-282e-46d3-a567-91f40a50d544","Type":"ContainerDied","Data":"bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c"}
Aug 04 16:08:58.142789 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.142712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd" event={"ID":"6b54125b-282e-46d3-a567-91f40a50d544","Type":"ContainerDied","Data":"1017d97423858c9fec0d8039833c4ae874c5d28eb25f5633142faac41207acb9"}
Aug 04 16:08:58.142789 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.142734    2581 scope.go:117] "RemoveContainer" containerID="bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c"
Aug 04 16:08:58.151998 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.151976    2581 scope.go:117] "RemoveContainer" containerID="bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c"
Aug 04 16:08:58.152329 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:08:58.152307    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c\": container with ID starting with bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c not found: ID does not exist" containerID="bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c"
Aug 04 16:08:58.152417 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.152341    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c"} err="failed to get container status \"bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c\": rpc error: code = NotFound desc = could not find container \"bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c\": container with ID starting with bb0ee210716355d3bd895930f5112431f1b24f4c0e7084c4566b84de43d6064c not found: ID does not exist"
Aug 04 16:08:58.180142 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.180103    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"]
Aug 04 16:08:58.184020 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.183993    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-e9e4ac-dcc8db9bb-p9chd"]
Aug 04 16:08:58.301856 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.301826    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35d6fbdd-3965-45fd-9233-e4c40cbbd67b" path="/var/lib/kubelet/pods/35d6fbdd-3965-45fd-9233-e4c40cbbd67b/volumes"
Aug 04 16:08:58.302215 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:08:58.302201    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b54125b-282e-46d3-a567-91f40a50d544" path="/var/lib/kubelet/pods/6b54125b-282e-46d3-a567-91f40a50d544/volumes"
Aug 04 16:09:47.981969 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.981931    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"]
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982253    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35d6fbdd-3965-45fd-9233-e4c40cbbd67b" containerName="revoke-keys"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982263    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="35d6fbdd-3965-45fd-9233-e4c40cbbd67b" containerName="revoke-keys"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982274    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982280    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982288    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982293    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982312    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b54125b-282e-46d3-a567-91f40a50d544" containerName="maas-api"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982318    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b54125b-282e-46d3-a567-91f40a50d544" containerName="maas-api"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982367    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982376    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc4e919e-d818-415f-b8eb-0a3ffd6b48db" containerName="istio-proxy"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982381    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b54125b-282e-46d3-a567-91f40a50d544" containerName="maas-api"
Aug 04 16:09:47.982444 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.982389    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="35d6fbdd-3965-45fd-9233-e4c40cbbd67b" containerName="revoke-keys"
Aug 04 16:09:47.985330 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.985314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:47.990311 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.990288    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 16:09:47.990448 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:47.990292    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 16:09:48.001943 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:48.001916    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"]
Aug 04 16:09:48.041315 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:48.041279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b08d818-09a3-4d73-b224-efb5154e4448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw\" (UID: \"5b08d818-09a3-4d73-b224-efb5154e4448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:48.142322 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:48.142289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b08d818-09a3-4d73-b224-efb5154e4448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw\" (UID: \"5b08d818-09a3-4d73-b224-efb5154e4448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:48.143008 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:48.142987    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b08d818-09a3-4d73-b224-efb5154e4448-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw\" (UID: \"5b08d818-09a3-4d73-b224-efb5154e4448\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:48.294987 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:48.294898    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:48.430799 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:48.430557    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"]
Aug 04 16:09:48.433405 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:09:48.433378    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b08d818_09a3_4d73_b224_efb5154e4448.slice/crio-c1af0e9781ea4a5b15568efb292d627d6a50873d16f92a9e4d73657d8032abf9 WatchSource:0}: Error finding container c1af0e9781ea4a5b15568efb292d627d6a50873d16f92a9e4d73657d8032abf9: Status 404 returned error can't find the container with id c1af0e9781ea4a5b15568efb292d627d6a50873d16f92a9e4d73657d8032abf9
Aug 04 16:09:49.383399 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:49.383364    2581 generic.go:356] "Generic (PLEG): container finished" podID="5b08d818-09a3-4d73-b224-efb5154e4448" containerID="f67bf384622f7a32e374b4af4c25586ec03ddc9038542334a5c811f1ad090c0c" exitCode=0
Aug 04 16:09:49.383862 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:49.383448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw" event={"ID":"5b08d818-09a3-4d73-b224-efb5154e4448","Type":"ContainerDied","Data":"f67bf384622f7a32e374b4af4c25586ec03ddc9038542334a5c811f1ad090c0c"}
Aug 04 16:09:49.383862 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:49.383503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw" event={"ID":"5b08d818-09a3-4d73-b224-efb5154e4448","Type":"ContainerStarted","Data":"c1af0e9781ea4a5b15568efb292d627d6a50873d16f92a9e4d73657d8032abf9"}
Aug 04 16:09:50.522926 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:50.522902    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:50.665288 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:50.665197    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b08d818-09a3-4d73-b224-efb5154e4448-maas-api-service-ca\") pod \"5b08d818-09a3-4d73-b224-efb5154e4448\" (UID: \"5b08d818-09a3-4d73-b224-efb5154e4448\") "
Aug 04 16:09:50.665586 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:50.665556    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b08d818-09a3-4d73-b224-efb5154e4448-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5b08d818-09a3-4d73-b224-efb5154e4448" (UID: "5b08d818-09a3-4d73-b224-efb5154e4448"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:09:50.766860 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:50.766829    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b08d818-09a3-4d73-b224-efb5154e4448-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:09:51.397585 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:51.397497    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw" event={"ID":"5b08d818-09a3-4d73-b224-efb5154e4448","Type":"ContainerDied","Data":"c1af0e9781ea4a5b15568efb292d627d6a50873d16f92a9e4d73657d8032abf9"}
Aug 04 16:09:51.397792 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:51.397611    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c1af0e9781ea4a5b15568efb292d627d6a50873d16f92a9e4d73657d8032abf9"
Aug 04 16:09:51.397792 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:51.397564    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"
Aug 04 16:09:58.630673 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.630511    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"]
Aug 04 16:09:58.631228 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.630924    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k" podUID="31b5ab72-442e-4e3e-bce9-cc481676f395" containerName="payload-processing" containerID="cri-o://045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa" gracePeriod=30
Aug 04 16:09:58.633040 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.633013    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"]
Aug 04 16:09:58.633383 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.633224    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb" podUID="5fc5ee15-195c-4031-8f58-e7b8edec7dbd" containerName="payload-pre-processing" containerID="cri-o://a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77" gracePeriod=30
Aug 04 16:09:58.848352 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.847962    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"]
Aug 04 16:09:58.852867 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.852780    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d94d35-h8ttw"]
Aug 04 16:09:58.899681 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.899656    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:09:58.925172 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:58.925147    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:09:59.037662 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.037628    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b5ab72-442e-4e3e-bce9-cc481676f395-plugins-config-volume\") pod \"31b5ab72-442e-4e3e-bce9-cc481676f395\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") "
Aug 04 16:09:59.037829 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.037687    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frlsq\" (UniqueName: \"kubernetes.io/projected/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-kube-api-access-frlsq\") pod \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") "
Aug 04 16:09:59.037829 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.037709    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gwkk\" (UniqueName: \"kubernetes.io/projected/31b5ab72-442e-4e3e-bce9-cc481676f395-kube-api-access-2gwkk\") pod \"31b5ab72-442e-4e3e-bce9-cc481676f395\" (UID: \"31b5ab72-442e-4e3e-bce9-cc481676f395\") "
Aug 04 16:09:59.037918 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.037880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-plugins-config-volume\") pod \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\" (UID: \"5fc5ee15-195c-4031-8f58-e7b8edec7dbd\") "
Aug 04 16:09:59.038047 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.038026    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b5ab72-442e-4e3e-bce9-cc481676f395-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "31b5ab72-442e-4e3e-bce9-cc481676f395" (UID: "31b5ab72-442e-4e3e-bce9-cc481676f395"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:09:59.038267 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.038243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5fc5ee15-195c-4031-8f58-e7b8edec7dbd" (UID: "5fc5ee15-195c-4031-8f58-e7b8edec7dbd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:09:59.038267 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.038261    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/31b5ab72-442e-4e3e-bce9-cc481676f395-plugins-config-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:09:59.039967 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.039946    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-kube-api-access-frlsq" (OuterVolumeSpecName: "kube-api-access-frlsq") pod "5fc5ee15-195c-4031-8f58-e7b8edec7dbd" (UID: "5fc5ee15-195c-4031-8f58-e7b8edec7dbd"). InnerVolumeSpecName "kube-api-access-frlsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:09:59.040037 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.039964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b5ab72-442e-4e3e-bce9-cc481676f395-kube-api-access-2gwkk" (OuterVolumeSpecName: "kube-api-access-2gwkk") pod "31b5ab72-442e-4e3e-bce9-cc481676f395" (UID: "31b5ab72-442e-4e3e-bce9-cc481676f395"). InnerVolumeSpecName "kube-api-access-2gwkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:09:59.138852 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.138748    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frlsq\" (UniqueName: \"kubernetes.io/projected/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-kube-api-access-frlsq\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:09:59.138852 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.138789    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gwkk\" (UniqueName: \"kubernetes.io/projected/31b5ab72-442e-4e3e-bce9-cc481676f395-kube-api-access-2gwkk\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:09:59.138852 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.138801    2581 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5fc5ee15-195c-4031-8f58-e7b8edec7dbd-plugins-config-volume\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:09:59.434249 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.434157    2581 generic.go:356] "Generic (PLEG): container finished" podID="5fc5ee15-195c-4031-8f58-e7b8edec7dbd" containerID="a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77" exitCode=0
Aug 04 16:09:59.434249 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.434207    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"
Aug 04 16:09:59.434499 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.434243    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb" event={"ID":"5fc5ee15-195c-4031-8f58-e7b8edec7dbd","Type":"ContainerDied","Data":"a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77"}
Aug 04 16:09:59.434499 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.434296    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb" event={"ID":"5fc5ee15-195c-4031-8f58-e7b8edec7dbd","Type":"ContainerDied","Data":"b173cf416d7d4c3f37cc9eec205bef3236c8982b330768761b245fe22ed2aecd"}
Aug 04 16:09:59.434499 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.434320    2581 scope.go:117] "RemoveContainer" containerID="a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77"
Aug 04 16:09:59.435602 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.435580    2581 generic.go:356] "Generic (PLEG): container finished" podID="31b5ab72-442e-4e3e-bce9-cc481676f395" containerID="045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa" exitCode=0
Aug 04 16:09:59.435708 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.435636    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"
Aug 04 16:09:59.435708 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.435651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k" event={"ID":"31b5ab72-442e-4e3e-bce9-cc481676f395","Type":"ContainerDied","Data":"045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa"}
Aug 04 16:09:59.435708 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.435681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k" event={"ID":"31b5ab72-442e-4e3e-bce9-cc481676f395","Type":"ContainerDied","Data":"e66f7dbe1891f96a914e9c1524ad539c3a9f3b952fcd9728485b70e47efdc897"}
Aug 04 16:09:59.444886 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.444863    2581 scope.go:117] "RemoveContainer" containerID="a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77"
Aug 04 16:09:59.445195 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:09:59.445175    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77\": container with ID starting with a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77 not found: ID does not exist" containerID="a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77"
Aug 04 16:09:59.445271 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.445204    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77"} err="failed to get container status \"a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77\": rpc error: code = NotFound desc = could not find container \"a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77\": container with ID starting with a7807929a5d06fdfc859b66fca1da4455934dd3ba15052dee8b241bf19cb8a77 not found: ID does not exist"
Aug 04 16:09:59.445271 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.445222    2581 scope.go:117] "RemoveContainer" containerID="045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa"
Aug 04 16:09:59.454605 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.454583    2581 scope.go:117] "RemoveContainer" containerID="045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa"
Aug 04 16:09:59.454915 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:09:59.454893    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa\": container with ID starting with 045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa not found: ID does not exist" containerID="045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa"
Aug 04 16:09:59.454978 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.454927    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa"} err="failed to get container status \"045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa\": rpc error: code = NotFound desc = could not find container \"045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa\": container with ID starting with 045977d7a2cad60bb45019dbcf73cbf698a3cfd74233cd193901587529943baa not found: ID does not exist"
Aug 04 16:09:59.461074 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.461038    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"]
Aug 04 16:09:59.464994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.464961    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d94d35-6b79f8ccd4-m74lb"]
Aug 04 16:09:59.479450 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.479418    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"]
Aug 04 16:09:59.486352 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:09:59.486316    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-d94d35-685f7db7fd-w6h2k"]
Aug 04 16:10:00.302328 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:00.302296    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b5ab72-442e-4e3e-bce9-cc481676f395" path="/var/lib/kubelet/pods/31b5ab72-442e-4e3e-bce9-cc481676f395/volumes"
Aug 04 16:10:00.302741 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:00.302662    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b08d818-09a3-4d73-b224-efb5154e4448" path="/var/lib/kubelet/pods/5b08d818-09a3-4d73-b224-efb5154e4448/volumes"
Aug 04 16:10:00.302962 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:00.302949    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fc5ee15-195c-4031-8f58-e7b8edec7dbd" path="/var/lib/kubelet/pods/5fc5ee15-195c-4031-8f58-e7b8edec7dbd/volumes"
Aug 04 16:10:05.822747 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:05.822711    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"]
Aug 04 16:10:05.823124 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:05.822952    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy" containerID="cri-o://c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45" gracePeriod=30
Aug 04 16:10:06.223569 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223519    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"]
Aug 04 16:10:06.223830 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223819    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b08d818-09a3-4d73-b224-efb5154e4448" containerName="revoke-keys"
Aug 04 16:10:06.223875 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223832    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b08d818-09a3-4d73-b224-efb5154e4448" containerName="revoke-keys"
Aug 04 16:10:06.223875 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223842    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fc5ee15-195c-4031-8f58-e7b8edec7dbd" containerName="payload-pre-processing"
Aug 04 16:10:06.223875 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223848    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fc5ee15-195c-4031-8f58-e7b8edec7dbd" containerName="payload-pre-processing"
Aug 04 16:10:06.223875 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223854    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b5ab72-442e-4e3e-bce9-cc481676f395" containerName="payload-processing"
Aug 04 16:10:06.223875 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223861    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b5ab72-442e-4e3e-bce9-cc481676f395" containerName="payload-processing"
Aug 04 16:10:06.224026 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223914    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b5ab72-442e-4e3e-bce9-cc481676f395" containerName="payload-processing"
Aug 04 16:10:06.224026 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223923    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fc5ee15-195c-4031-8f58-e7b8edec7dbd" containerName="payload-pre-processing"
Aug 04 16:10:06.224026 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.223930    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b08d818-09a3-4d73-b224-efb5154e4448" containerName="revoke-keys"
Aug 04 16:10:06.228011 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.227992    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:06.231309 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.231291    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 16:10:06.231564 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.231548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 16:10:06.242769 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.242746    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"]
Aug 04 16:10:06.400342 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.400311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d1b970-a394-4d33-ab4a-f9ffd27672e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g\" (UID: \"70d1b970-a394-4d33-ab4a-f9ffd27672e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:06.501361 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.501273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d1b970-a394-4d33-ab4a-f9ffd27672e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g\" (UID: \"70d1b970-a394-4d33-ab4a-f9ffd27672e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:06.501918 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.501899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d1b970-a394-4d33-ab4a-f9ffd27672e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g\" (UID: \"70d1b970-a394-4d33-ab4a-f9ffd27672e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:06.538032 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.538002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:06.686755 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:06.686623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"]
Aug 04 16:10:06.692105 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:10:06.692073    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d1b970_a394_4d33_ab4a_f9ffd27672e1.slice/crio-43eec1aef7df1341e711e5f6e707ad335fb894a519620138e533e8aa36563177 WatchSource:0}: Error finding container 43eec1aef7df1341e711e5f6e707ad335fb894a519620138e533e8aa36563177: Status 404 returned error can't find the container with id 43eec1aef7df1341e711e5f6e707ad335fb894a519620138e533e8aa36563177
Aug 04 16:10:07.481855 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:07.481822    2581 generic.go:356] "Generic (PLEG): container finished" podID="70d1b970-a394-4d33-ab4a-f9ffd27672e1" containerID="f63da2de0a0fb6da71d5236ee6e18f7d230c6cb3cdd97a93f85e944f0817aa9a" exitCode=0
Aug 04 16:10:07.482293 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:07.481899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g" event={"ID":"70d1b970-a394-4d33-ab4a-f9ffd27672e1","Type":"ContainerDied","Data":"f63da2de0a0fb6da71d5236ee6e18f7d230c6cb3cdd97a93f85e944f0817aa9a"}
Aug 04 16:10:07.482293 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:07.481960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g" event={"ID":"70d1b970-a394-4d33-ab4a-f9ffd27672e1","Type":"ContainerStarted","Data":"43eec1aef7df1341e711e5f6e707ad335fb894a519620138e533e8aa36563177"}
Aug 04 16:10:08.614652 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:08.614627    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:08.721046 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:08.721015    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d1b970-a394-4d33-ab4a-f9ffd27672e1-maas-api-service-ca\") pod \"70d1b970-a394-4d33-ab4a-f9ffd27672e1\" (UID: \"70d1b970-a394-4d33-ab4a-f9ffd27672e1\") "
Aug 04 16:10:08.721366 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:08.721344    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70d1b970-a394-4d33-ab4a-f9ffd27672e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70d1b970-a394-4d33-ab4a-f9ffd27672e1" (UID: "70d1b970-a394-4d33-ab4a-f9ffd27672e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:08.822392 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:08.822292    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70d1b970-a394-4d33-ab4a-f9ffd27672e1-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:09.492616 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:09.492580    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g" event={"ID":"70d1b970-a394-4d33-ab4a-f9ffd27672e1","Type":"ContainerDied","Data":"43eec1aef7df1341e711e5f6e707ad335fb894a519620138e533e8aa36563177"}
Aug 04 16:10:09.492616 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:09.492597    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"
Aug 04 16:10:09.492821 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:09.492630    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43eec1aef7df1341e711e5f6e707ad335fb894a519620138e533e8aa36563177"
Aug 04 16:10:11.074288 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.074265    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:10:11.242155 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5skg4\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-kube-api-access-5skg4\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242347 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242184    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-certs\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242347 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-credential-socket\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242347 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242325    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-token\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242580 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-podinfo\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242580 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242455    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-data\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242580 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242520    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:11.242580 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-socket\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242580 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242570    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:11.242826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242590    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istiod-ca-cert\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242618    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-envoy\") pod \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\" (UID: \"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51\") "
Aug 04 16:10:11.242826 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:11.242994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242880    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.242994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242908    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-workload-certs\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.242994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242920    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-credential-socket\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.243119 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.242992    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:11.243998 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.243955    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:11.245031 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.245002    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 16:10:11.245143 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.245083    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:11.245202 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.245150    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 04 16:10:11.245202 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.245161    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-kube-api-access-5skg4" (OuterVolumeSpecName: "kube-api-access-5skg4") pod "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" (UID: "4ef3b643-1c51-4d95-a66e-1a6a7ea4de51"). InnerVolumeSpecName "kube-api-access-5skg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:11.344131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.344093    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5skg4\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-kube-api-access-5skg4\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.344131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.344123    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-token\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.344131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.344134    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-podinfo\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.344131 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.344143    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-data\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.344411 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.344151    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istiod-ca-cert\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.344411 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.344159    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51-istio-envoy\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.503105 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.503027    2581 generic.go:356] "Generic (PLEG): container finished" podID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerID="c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45" exitCode=0
Aug 04 16:10:11.503105 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.503069    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"
Aug 04 16:10:11.503277 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.503113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" event={"ID":"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51","Type":"ContainerDied","Data":"c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45"}
Aug 04 16:10:11.503277 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.503169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw" event={"ID":"4ef3b643-1c51-4d95-a66e-1a6a7ea4de51","Type":"ContainerDied","Data":"36ee114c87f49592fb4229cf196aca8204a714810dc24f5f7b9641e36abf6c06"}
Aug 04 16:10:11.503277 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.503192    2581 scope.go:117] "RemoveContainer" containerID="c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45"
Aug 04 16:10:11.516201 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.516122    2581 scope.go:117] "RemoveContainer" containerID="b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"
Aug 04 16:10:11.526404 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.526379    2581 scope.go:117] "RemoveContainer" containerID="c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45"
Aug 04 16:10:11.526746 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:10:11.526721    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45\": container with ID starting with c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45 not found: ID does not exist" containerID="c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45"
Aug 04 16:10:11.526850 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.526758    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45"} err="failed to get container status \"c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45\": rpc error: code = NotFound desc = could not find container \"c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45\": container with ID starting with c5af9cb31948f7554d707d023be8c6b19165774d6f744de4bac46b28e0ac5f45 not found: ID does not exist"
Aug 04 16:10:11.526850 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.526780    2581 scope.go:117] "RemoveContainer" containerID="b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"
Aug 04 16:10:11.527082 ip-10-0-137-247 kubenswrapper[2581]: E0804 16:10:11.527051    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0\": container with ID starting with b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0 not found: ID does not exist" containerID="b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"
Aug 04 16:10:11.527213 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.527084    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0"} err="failed to get container status \"b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0\": rpc error: code = NotFound desc = could not find container \"b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0\": container with ID starting with b1cf35b169d7fdb33a67653af9ebd07fa7eaee5df9719a9d58a1977e777cbbb0 not found: ID does not exist"
Aug 04 16:10:11.531863 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.531838    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"]
Aug 04 16:10:11.542994 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.542974    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d94d35-openshift-default-75b77dcb58-2wpxw"]
Aug 04 16:10:11.587074 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.587043    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"]
Aug 04 16:10:11.588681 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.588654    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-05b2bc-29764320-c2rrs"]
Aug 04 16:10:11.856145 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.856014    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"]
Aug 04 16:10:11.859341 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:11.859316    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-05b2bc-nr47g"]
Aug 04 16:10:12.309918 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:12.309883    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="457e6773-2cbb-4c37-b3da-02f668882d84" path="/var/lib/kubelet/pods/457e6773-2cbb-4c37-b3da-02f668882d84/volumes"
Aug 04 16:10:12.310281 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:12.310247    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" path="/var/lib/kubelet/pods/4ef3b643-1c51-4d95-a66e-1a6a7ea4de51/volumes"
Aug 04 16:10:12.310569 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:12.310553    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70d1b970-a394-4d33-ab4a-f9ffd27672e1" path="/var/lib/kubelet/pods/70d1b970-a394-4d33-ab4a-f9ffd27672e1/volumes"
Aug 04 16:10:19.369230 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369185    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"]
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369503    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70d1b970-a394-4d33-ab4a-f9ffd27672e1" containerName="revoke-keys"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369515    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="70d1b970-a394-4d33-ab4a-f9ffd27672e1" containerName="revoke-keys"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369561    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369567    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369576    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369581    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369635    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="70d1b970-a394-4d33-ab4a-f9ffd27672e1" containerName="revoke-keys"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369642    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy"
Aug 04 16:10:19.369646 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.369649    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ef3b643-1c51-4d95-a66e-1a6a7ea4de51" containerName="istio-proxy"
Aug 04 16:10:19.374021 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.373997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:19.376900 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.376879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 16:10:19.377046 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.376881    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 16:10:19.382660 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.382631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"]
Aug 04 16:10:19.413686 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.413649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ccedbd3-5e7c-4753-a050-21d80fb3129c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4\" (UID: \"3ccedbd3-5e7c-4753-a050-21d80fb3129c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:19.514409 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.514366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ccedbd3-5e7c-4753-a050-21d80fb3129c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4\" (UID: \"3ccedbd3-5e7c-4753-a050-21d80fb3129c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:19.515015 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.514996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ccedbd3-5e7c-4753-a050-21d80fb3129c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4\" (UID: \"3ccedbd3-5e7c-4753-a050-21d80fb3129c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:19.685162 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.685132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:19.824120 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:19.824075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"]
Aug 04 16:10:19.826284 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:10:19.826255    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ccedbd3_5e7c_4753_a050_21d80fb3129c.slice/crio-8b06324c0c77b642ee557bbb6fc6bc4e3d470db6f2f15daf70d54fdf1bb97f47 WatchSource:0}: Error finding container 8b06324c0c77b642ee557bbb6fc6bc4e3d470db6f2f15daf70d54fdf1bb97f47: Status 404 returned error can't find the container with id 8b06324c0c77b642ee557bbb6fc6bc4e3d470db6f2f15daf70d54fdf1bb97f47
Aug 04 16:10:20.546553 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:20.546492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4" event={"ID":"3ccedbd3-5e7c-4753-a050-21d80fb3129c","Type":"ContainerStarted","Data":"608e6f373634475783c01e790ae6d80604bf8cb450c57068705fbe952c16bda6"}
Aug 04 16:10:20.546934 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:20.546579    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4" event={"ID":"3ccedbd3-5e7c-4753-a050-21d80fb3129c","Type":"ContainerStarted","Data":"8b06324c0c77b642ee557bbb6fc6bc4e3d470db6f2f15daf70d54fdf1bb97f47"}
Aug 04 16:10:20.567222 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:20.567177    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4" podStartSLOduration=1.567161351 podStartE2EDuration="1.567161351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:10:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:10:20.56574554 +0000 UTC m=+3834.780758337" watchObservedRunningTime="2026-08-04 16:10:20.567161351 +0000 UTC m=+3834.782174148"
Aug 04 16:10:21.552490 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:21.552455    2581 generic.go:356] "Generic (PLEG): container finished" podID="3ccedbd3-5e7c-4753-a050-21d80fb3129c" containerID="608e6f373634475783c01e790ae6d80604bf8cb450c57068705fbe952c16bda6" exitCode=0
Aug 04 16:10:21.552926 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:21.552565    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4" event={"ID":"3ccedbd3-5e7c-4753-a050-21d80fb3129c","Type":"ContainerDied","Data":"608e6f373634475783c01e790ae6d80604bf8cb450c57068705fbe952c16bda6"}
Aug 04 16:10:22.686972 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:22.686948    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:22.734123 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:22.734097    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ccedbd3-5e7c-4753-a050-21d80fb3129c-maas-api-service-ca\") pod \"3ccedbd3-5e7c-4753-a050-21d80fb3129c\" (UID: \"3ccedbd3-5e7c-4753-a050-21d80fb3129c\") "
Aug 04 16:10:22.734425 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:22.734397    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ccedbd3-5e7c-4753-a050-21d80fb3129c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ccedbd3-5e7c-4753-a050-21d80fb3129c" (UID: "3ccedbd3-5e7c-4753-a050-21d80fb3129c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:22.834974 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:22.834878    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ccedbd3-5e7c-4753-a050-21d80fb3129c-maas-api-service-ca\") on node \"ip-10-0-137-247.ec2.internal\" DevicePath \"\""
Aug 04 16:10:23.564218 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:23.564179    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4" event={"ID":"3ccedbd3-5e7c-4753-a050-21d80fb3129c","Type":"ContainerDied","Data":"8b06324c0c77b642ee557bbb6fc6bc4e3d470db6f2f15daf70d54fdf1bb97f47"}
Aug 04 16:10:23.564218 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:23.564210    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"
Aug 04 16:10:23.564403 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:23.564240    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b06324c0c77b642ee557bbb6fc6bc4e3d470db6f2f15daf70d54fdf1bb97f47"
Aug 04 16:10:26.747921 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:26.747890    2581 scope.go:117] "RemoveContainer" containerID="4478b08213c50fbb776ea98de1cb4d153a5d0ce5b719a80a3ea73303d23922e3"
Aug 04 16:10:29.881253 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:29.881208    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"]
Aug 04 16:10:29.883433 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:29.883408    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-7b41f3-29764320-4vlfs"]
Aug 04 16:10:30.074397 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:30.074362    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"]
Aug 04 16:10:30.075788 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:30.075767    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-7b41f3-b49t4"]
Aug 04 16:10:30.301928 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:30.301890    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ccedbd3-5e7c-4753-a050-21d80fb3129c" path="/var/lib/kubelet/pods/3ccedbd3-5e7c-4753-a050-21d80fb3129c/volumes"
Aug 04 16:10:30.302209 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:30.302195    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b5945c-eb40-4f1e-99e8-70f248305d04" path="/var/lib/kubelet/pods/91b5945c-eb40-4f1e-99e8-70f248305d04/volumes"
Aug 04 16:10:44.268515 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:44.268485    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-gxbl8_5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e/copy-manifests/0.log"
Aug 04 16:10:44.282427 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:44.282388    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-gxbl8_5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e/manager/0.log"
Aug 04 16:10:45.009023 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:45.008995    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764305-n6djv_51ec576f-3c82-4602-b3b5-107060aa4a8d/cleanup/0.log"
Aug 04 16:10:45.127442 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:45.127414    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764320-tjb6m_6b46a130-d6ad-4e45-b61b-e46aa6c3d135/cleanup/0.log"
Aug 04 16:10:47.235574 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:47.235523    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zsc6h_76735616-36c9-46d2-9733-d921b1d4cf57/manager/0.log"
Aug 04 16:10:47.988920 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:47.988876    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qkcw9_bab4ecc2-9d40-4614-9e90-ea1bd32992f7/discovery/0.log"
Aug 04 16:10:49.098252 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:49.098196    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-2545n_f8a1548d-b966-4711-92c7-82660873a886/main/0.log"
Aug 04 16:10:49.344791 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:49.344761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-9ksxx_35d89b70-8279-4087-ba78-6b5a1aa8de0e/main/0.log"
Aug 04 16:10:58.741327 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:58.741298    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mtnjh_6cf35354-ac57-4479-906c-20c8a2243e10/global-pull-secret-syncer/0.log"
Aug 04 16:10:58.945310 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:58.945281    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xq2ng_accd62b8-2240-4a4d-a798-d0b60190dd70/konnectivity-agent/0.log"
Aug 04 16:10:59.022992 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:10:59.022908    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-247.ec2.internal_3768d099968536462897c691c261bff2/haproxy/0.log"
Aug 04 16:11:04.104726 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:04.104691    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zsc6h_76735616-36c9-46d2-9733-d921b1d4cf57/manager/0.log"
Aug 04 16:11:06.728082 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:06.728051    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xkdff_62f85030-004b-4bd9-942e-87400f537e74/node-exporter/0.log"
Aug 04 16:11:06.759280 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:06.759254    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xkdff_62f85030-004b-4bd9-942e-87400f537e74/kube-rbac-proxy/0.log"
Aug 04 16:11:06.792848 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:06.792824    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xkdff_62f85030-004b-4bd9-942e-87400f537e74/init-textfile/0.log"
Aug 04 16:11:07.264648 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:07.264618    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-cgkj4_d159d623-cdbd-42ce-8dbd-08f14094e36e/prometheus-operator-admission-webhook/0.log"
Aug 04 16:11:08.631235 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.631201    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"]
Aug 04 16:11:08.631631 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.631492    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ccedbd3-5e7c-4753-a050-21d80fb3129c" containerName="revoke-keys"
Aug 04 16:11:08.631631 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.631503    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ccedbd3-5e7c-4753-a050-21d80fb3129c" containerName="revoke-keys"
Aug 04 16:11:08.631631 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.631565    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ccedbd3-5e7c-4753-a050-21d80fb3129c" containerName="revoke-keys"
Aug 04 16:11:08.634711 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.634687    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.638795 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.638771    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sz4ht\"/\"openshift-service-ca.crt\""
Aug 04 16:11:08.638795 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.638788    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sz4ht\"/\"kube-root-ca.crt\""
Aug 04 16:11:08.638939 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.638774    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sz4ht\"/\"default-dockercfg-twtxh\""
Aug 04 16:11:08.646924 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.646904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"]
Aug 04 16:11:08.726828 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.726797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-podres\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.726995 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.726837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-sys\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.726995 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.726869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-lib-modules\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.726995 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.726951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6rpk\" (UniqueName: \"kubernetes.io/projected/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-kube-api-access-f6rpk\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.726995 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.726986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-proc\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828169 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-podres\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828375 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-sys\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828375 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-lib-modules\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828375 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6rpk\" (UniqueName: \"kubernetes.io/projected/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-kube-api-access-f6rpk\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828375 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-proc\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828375 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-sys\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828375 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-podres\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828637 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828375    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-lib-modules\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.828637 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.828389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-proc\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.847146 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.847120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6rpk\" (UniqueName: \"kubernetes.io/projected/c8002dbb-ea0f-4f4c-ad4b-1548620be7b0-kube-api-access-f6rpk\") pod \"perf-node-gather-daemonset-8smpg\" (UID: \"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:08.944251 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:08.944225    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:09.093351 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:09.093324    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"]
Aug 04 16:11:09.095782 ip-10-0-137-247 kubenswrapper[2581]: W0804 16:11:09.095739    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8002dbb_ea0f_4f4c_ad4b_1548620be7b0.slice/crio-b373bef8c36ff86c3dac86acb80c74818e092622fbbdf76c5fa391947774f42a WatchSource:0}: Error finding container b373bef8c36ff86c3dac86acb80c74818e092622fbbdf76c5fa391947774f42a: Status 404 returned error can't find the container with id b373bef8c36ff86c3dac86acb80c74818e092622fbbdf76c5fa391947774f42a
Aug 04 16:11:09.778277 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:09.778239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg" event={"ID":"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0","Type":"ContainerStarted","Data":"7d91d1e5c67627873176cfa6264616fc93716d6cc8ba2d65c876eca5a65e851a"}
Aug 04 16:11:09.778794 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:09.778290    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg" event={"ID":"c8002dbb-ea0f-4f4c-ad4b-1548620be7b0","Type":"ContainerStarted","Data":"b373bef8c36ff86c3dac86acb80c74818e092622fbbdf76c5fa391947774f42a"}
Aug 04 16:11:09.778794 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:09.778312    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:09.802732 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:09.802677    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg" podStartSLOduration=1.802662757 podStartE2EDuration="1.802662757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:09.801736769 +0000 UTC m=+3884.016749570" watchObservedRunningTime="2026-08-04 16:11:09.802662757 +0000 UTC m=+3884.017675584"
Aug 04 16:11:10.050314 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:10.050233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-4b5ff_051358b0-92c2-4bd2-bc39-fa68fc169124/download-server/0.log"
Aug 04 16:11:11.955739 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:11.955684    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j5kq2_d46cb900-8fa0-45d4-a6a9-786659633dc7/dns/0.log"
Aug 04 16:11:11.983002 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:11.982974    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j5kq2_d46cb900-8fa0-45d4-a6a9-786659633dc7/kube-rbac-proxy/0.log"
Aug 04 16:11:12.075925 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:12.075890    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9kf6d_48028eed-5735-4146-a227-19f187a5af5f/dns-node-resolver/0.log"
Aug 04 16:11:12.802600 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:12.802563    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-557b744bcb-lfq9d_53e10a0f-ae4e-4a49-9fec-cff7b73d60d5/registry/0.log"
Aug 04 16:11:12.859251 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:12.859206    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vn8zq_de1c4cc2-9902-431e-828b-f26f2f680113/node-ca/0.log"
Aug 04 16:11:14.100258 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:14.100221    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qkcw9_bab4ecc2-9d40-4614-9e90-ea1bd32992f7/discovery/0.log"
Aug 04 16:11:15.214252 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:15.214225    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7f2tt_75f9a334-cb62-4030-9008-32c2c225241b/serve-healthcheck-canary/0.log"
Aug 04 16:11:15.793177 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:15.793148    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-8smpg"
Aug 04 16:11:15.949674 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:15.949646    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjj2j_1d1b8299-929e-4359-a39e-7633d034be0e/kube-rbac-proxy/0.log"
Aug 04 16:11:15.978446 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:15.978412    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjj2j_1d1b8299-929e-4359-a39e-7633d034be0e/exporter/0.log"
Aug 04 16:11:16.005925 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:16.005891    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wjj2j_1d1b8299-929e-4359-a39e-7633d034be0e/extractor/0.log"
Aug 04 16:11:19.509635 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:19.509594    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-gxbl8_5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e/manager/0.log"
Aug 04 16:11:19.538156 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:19.538080    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-gxbl8_5ae9fd5f-7dcb-49b3-8b29-1e6c11d47e6e/copy-manifests/0.log"
Aug 04 16:11:19.552305 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:19.552277    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qkcw9_bab4ecc2-9d40-4614-9e90-ea1bd32992f7/discovery/0.log"
Aug 04 16:11:20.977494 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:20.977466    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-598d546c6b-xrf4n_38d163f6-df6a-4a8d-8776-519601340e49/manager/0.log"
Aug 04 16:11:21.382622 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:21.382543    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qkcw9_bab4ecc2-9d40-4614-9e90-ea1bd32992f7/discovery/0.log"
Aug 04 16:11:25.961546 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:25.961510    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-n9b96_cbd9f097-5420-471c-8246-fe3ee1efa4ed/migrator/0.log"
Aug 04 16:11:25.987222 ip-10-0-137-247 kubenswrapper[2581]: I0804 16:11:25.987189    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-n9b96_cbd9f097-5420-471c-8246-fe3ee1efa4ed/graceful-termination/0.log"