Jul 21 16:22:58.936451 ip-10-0-142-11 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 16:22:58.936471 ip-10-0-142-11 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 16:22:58.936478 ip-10-0-142-11 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 16:22:58.936740 ip-10-0-142-11 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 16:23:08.958901 ip-10-0-142-11 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 16:23:08.958921 ip-10-0-142-11 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e22b3d06d272425cbb99650c4cccf486 --
Jul 21 16:25:02.216388 ip-10-0-142-11 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.552161    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560098    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560117    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560121    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560124    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560127    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560129    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560132    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:25:02.580897 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560135    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560138    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560140    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560143    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560146    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560148    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560151    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560154    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560156    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560159    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560163    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560165    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560169    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560171    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560176    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560179    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560182    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560185    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560187    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560190    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:25:02.582466 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560192    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560195    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560198    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560200    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560203    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560207    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560212    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560215    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560219    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560222    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560224    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560227    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560229    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560232    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560235    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560238    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560240    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560243    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560246    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:25:02.584767 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560248    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560251    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560253    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560256    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560260    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560263    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560266    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560268    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560271    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560274    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560277    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560279    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560282    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560284    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560288    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560290    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560293    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560296    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560299    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560301    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:25:02.586747 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560304    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560306    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560309    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560311    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560314    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560316    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560319    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560322    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560325    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560327    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560330    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560333    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560335    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560337    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560340    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560342    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560345    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560348    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560351    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560353    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:25:02.589460 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560357    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560360    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560363    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560366    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560368    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560371    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560374    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560376    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560379    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560383    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560386    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560389    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.560391    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561135    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561142    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561145    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561150    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561153    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561157    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:25:02.599371 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561160    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561163    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561166    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561169    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561172    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561175    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561178    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561181    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561183    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561186    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561189    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561192    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561195    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561199    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561202    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561205    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561207    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561210    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561213    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561216    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:25:02.600413 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561219    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561221    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561224    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561227    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561230    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561233    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561236    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561238    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561241    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561244    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561246    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561248    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561251    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561253    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561256    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561258    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561261    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561263    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561266    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561268    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:25:02.601915 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561271    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561273    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561276    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561278    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561283    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561285    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561288    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561291    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561294    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561297    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561300    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561302    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561305    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561308    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561310    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561313    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561315    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561317    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561320    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561323    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:25:02.602803 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561326    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561329    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561332    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561335    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561337    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561340    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561342    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561345    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561347    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561351    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561354    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561356    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561359    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561361    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561364    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561366    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561369    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561372    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561374    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561377    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:25:02.603864 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561379    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561382    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561385    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561388    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561390    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561395    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561398    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561400    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561403    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561406    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561408    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561411    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561414    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561818    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561823    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561826    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561828    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561831    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561834    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:25:02.608529 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561836    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561839    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561842    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561846    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561849    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561852    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561856    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561859    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561862    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561865    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561868    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561871    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561873    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561876    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561878    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561881    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561883    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561886    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561890    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:25:02.609391 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561894    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561897    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561900    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561903    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561906    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561909    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561912    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561914    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561917    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561920    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561922    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561925    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561928    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561930    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561933    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561936    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561938    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561941    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561943    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561946    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:25:02.610250 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561949    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561952    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561954    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561957    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561960    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561963    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561965    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561967    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561970    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561973    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561976    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561980    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561982    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561985    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561987    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561990    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561993    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561995    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.561998    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562000    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:25:02.611740 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562003    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562005    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562008    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562011    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562014    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562016    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562019    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562021    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562024    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562027    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562029    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562032    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562035    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562038    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562040    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562045    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562047    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562050    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562053    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562055    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:25:02.612814 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562058    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562060    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562063    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562067    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562084    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562087    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562091    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562094    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562097    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562100    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562103    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562105    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562108    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562110    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562196    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562204    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562211    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562215    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562219    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562223    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562227    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 16:25:02.613699 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562231    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562234    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562237    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562241    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562245    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562248    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562251    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562254    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562257    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562261    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562264    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562268    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562271    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562274    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562278    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562282    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562286    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562288    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562292    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562295    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562298    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562301    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562304    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562308    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 16:25:02.615834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562310    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562316    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562319    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562322    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562325    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562328    2577 flags.go:64] FLAG: --enable-server="true"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562331    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562336    2577 flags.go:64] FLAG: --event-burst="100"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562340    2577 flags.go:64] FLAG: --event-qps="50"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562343    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562346    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562349    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562352    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562355    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562358    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562361    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562364    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562367    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562371    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562373    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562376    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562379    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562383    2577 flags.go:64] FLAG: --feature-gates=""
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562387    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562389    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 16:25:02.617348 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562393    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562396    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562399    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562402    2577 flags.go:64] FLAG: --help="false"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562405    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-142-11.ec2.internal"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562408    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562411    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562414    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562419    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562422    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562425    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562428    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562431    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562433    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562436    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562439    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562442    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562445    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562448    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562451    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562453    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562456    2577 flags.go:64] FLAG: --lock-file=""
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562459    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562462    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 16:25:02.626917 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562465    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 16:25:02.624704 ip-10-0-142-11 systemd[1]: Started Kubernetes Kubelet.
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562470    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562474    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562477    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562479    2577 flags.go:64] FLAG: --logging-format="text"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562485    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562488    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562491    2577 flags.go:64] FLAG: --manifest-url=""
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562494    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562498    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562501    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562505    2577 flags.go:64] FLAG: --max-pods="110"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562508    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562512    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562514    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562517    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562522    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562525    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562528    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562535    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562538    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562541    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562544    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 21 16:25:02.628255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562547    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562553    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562556    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562559    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562562    2577 flags.go:64] FLAG: --port="10250"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562565    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562567    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f359a43345543b13"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562571    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562574    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562576    2577 flags.go:64] FLAG: --register-node="true"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562579    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562583    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562587    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562590    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562593    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562598    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562601    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562605    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562607    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562610    2577 flags.go:64] FLAG: --runonce="false"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562613    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562616    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562619    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562622    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562625    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562629    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 16:25:02.629563 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562632    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562635    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562638    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562641    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562644    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562647    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562650    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562653    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562655    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562660    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562663    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562666    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562670    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562673    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562675    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562678    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562681    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562684    2577 flags.go:64] FLAG: --v="2"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562687    2577 flags.go:64] FLAG: --version="false"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562694    2577 flags.go:64] FLAG: --vmodule=""
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562699    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.562703    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562834    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562838    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:25:02.630478 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562841    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562844    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562846    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562849    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562851    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562854    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562856    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562861    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562863    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562866    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562868    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562871    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562873    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562876    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562878    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562881    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562883    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562886    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562889    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562891    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:25:02.631205 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562894    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562896    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562899    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562901    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562904    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562906    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562909    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562911    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562914    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562918    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562921    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562923    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562926    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562929    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562932    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562934    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562937    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562940    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562944    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:25:02.631825 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562949    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562952    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562955    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562959    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562962    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562966    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562968    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562971    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562974    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562976    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562979    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562981    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562984    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562987    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562989    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562992    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562994    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562997    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.562999    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:25:02.632399 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563002    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563004    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563007    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563012    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563015    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563018    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563020    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563023    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563025    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563028    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563030    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563033    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563036    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563039    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563042    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563044    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563048    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563051    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563054    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563057    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:25:02.633096 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563059    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563062    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563065    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563081    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563084    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563087    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563089    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563092    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563094    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563097    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563099    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563102    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563105    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563108    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563110    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563114    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563117    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563120    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:25:02.633710 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.563123    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.563128    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.569494    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.569522    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.570299    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.570307    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570364    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570369    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570372    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570376    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570379    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570382    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570385    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570389    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570392    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:25:02.634353 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570395    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570398    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570401    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570404    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570407    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570411    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570416    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570420    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570424    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570427    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570430    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570433    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570436    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570439    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570442    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570444    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570447    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570450    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570453    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:25:02.635022 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570455    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570459    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570461    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570464    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570467    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570470    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570474    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570477    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570480    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570483    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570486    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570489    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570491    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570494    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570496    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570499    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570502    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570505    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570507    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:25:02.635667 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570510    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570512    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570515    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570518    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570520    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570523    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570525    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570528    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570530    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570533    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570535    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570538    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570541    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570543    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570546    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570549    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570552    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570554    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570557    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570559    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:25:02.636550 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570562    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570564    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570567    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570570    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570572    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570575    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570577    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570580    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570582    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570585    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570588    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570591    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570593    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570596    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570598    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570601    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570604    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570607    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570609    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570612    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:25:02.637193 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570615    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570617    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570620    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570622    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570625    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570627    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570630    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570632    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570635    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570638    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570640    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570645    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.570650    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570770    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570775    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 16:25:02.638949 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570779    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570784    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570788    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570791    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570794    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570796    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570799    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570802    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570805    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570808    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570811    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570813    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570816    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570819    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570821    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570823    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570826    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570828    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570831    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 16:25:02.640204 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570834    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570836    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570839    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570841    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570844    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570846    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570849    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570851    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570854    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570859    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570861    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570864    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570866    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570868    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570871    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570874    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570876    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570878    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570881    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570883    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 16:25:02.643301 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570888    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570890    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570893    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570895    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570897    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570900    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570903    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570905    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570908    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570911    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570913    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570916    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570920    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570923    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570926    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570929    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570932    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570935    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570937    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 16:25:02.644345 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570940    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570943    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570948    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570950    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570953    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570956    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570958    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570961    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570963    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570966    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570968    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570971    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570973    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570977    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570980    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570982    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570985    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570988    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570990    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570993    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 16:25:02.645841 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570995    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.570998    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571000    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571003    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571005    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571008    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571010    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571013    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571015    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571018    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571021    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571023    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571026    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571028    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571033    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571035    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571038    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571040    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 16:25:02.646911 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:02.571043    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.571048    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.571174    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.573150    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.574461    2577 server.go:1019] "Starting client certificate rotation"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.574566    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.574615    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.576610    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.581813    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.593143    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.595508    2577 log.go:25] "Validated CRI v1 image API"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.596346    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 16:25:02.648009 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.598583    2577 fs.go:135] Filesystem UUIDs: map[01052317-c032-4de3-96ac-99a8403211ff:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d732decf-e3be-4ef9-9234-988432714df6:/dev/nvme0n1p3]
Jul 21 16:25:02.648658 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.598600    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.603605    2577 manager.go:216] Machine: {Timestamp:2026-07-21 16:25:02.60305017 +0000 UTC m=+0.280017883 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100260 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6f73e22366e3b25b112516f9fc43 SystemUUID:ec2a6f73-e223-66e3-b25b-112516f9fc43 BootID:e22b3d06-d272-425c-bb99-650c4cccf486 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4f:f9:27:e9:fb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4f:f9:27:e9:fb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:ee:5a:8d:d9:a3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.603710    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.603790    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.605516    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.606191    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.606218    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-11.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 16:25:02.648870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.606817    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.606826    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.606833    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.607458    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.608598    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611795    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611912    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611941    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611951    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611962    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611971    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.611980    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.612340    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.612363    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.614167    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.616052    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.616094    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617161    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617174    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617181    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617186    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617195    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617201    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617209    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617214    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617221    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617226    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617235    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617240    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617937    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.617954    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.621269    2577 server.go:1268] "Started kubelet"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.621328    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.621357    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.621492    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.624929    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.627211    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.628662    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-11.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.628749    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.628888    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.638084    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 16:25:02.650414 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.638091    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.638567    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.638709    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.638824    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.638838    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639005    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639013    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639286    2577 factory.go:153] Registering CRI-O factory
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639302    2577 factory.go:223] Registration of the crio container factory successfully
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639349    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639359    2577 factory.go:55] Registering systemd factory
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639366    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639386    2577 factory.go:103] Registering Raw factory
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.639397    2577 manager.go:1196] Started watching for new ooms in manager
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.640044    2577 manager.go:349] Starting recovery of all containers
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.640621    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tgtsv"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.641867    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.649411    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.649451    2577 manager.go:354] Recovery completed
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.651617    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.651692    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-11.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 16:25:02.652550 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.651316    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-11.ec2.internal.18c45ab8ebbf9673  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-11.ec2.internal,UID:ip-10-0-142-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-11.ec2.internal,},FirstTimestamp:2026-07-21 16:25:02.621242995 +0000 UTC m=+0.298210764,LastTimestamp:2026-07-21 16:25:02.621242995 +0000 UTC m=+0.298210764,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-11.ec2.internal,}"
Jul 21 16:25:02.653801 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.653333    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tgtsv"
Jul 21 16:25:02.655644 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.655034    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.656892    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.656916    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.656926    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.657504    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.657515    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.657531    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.657539    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.658802    2577 policy_none.go:49] "None policy: Start"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.658822    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.658836    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.658843    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-11.ec2.internal.18c45ab8eddfbdad  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-11.ec2.internal,UID:ip-10-0-142-11.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-11.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-11.ec2.internal,},FirstTimestamp:2026-07-21 16:25:02.656904621 +0000 UTC m=+0.333872341,LastTimestamp:2026-07-21 16:25:02.656904621 +0000 UTC m=+0.333872341,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-11.ec2.internal,}"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.659377    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.659402    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.659449    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.660037    2577 policy_none.go:47] "Start"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.706743    2577 manager.go:337] "Starting Device Plugin manager"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.706896    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.706906    2577 server.go:87] "Starting device plugin registration server"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.707134    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.707143    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.707240    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.707338    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.707348    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.707816    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 16:25:02.784865 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.707858    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.807226    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.808368    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.808397    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.808410    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.808466    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-11.ec2.internal"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.821019    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-11.ec2.internal"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.821043    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-11.ec2.internal\": node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.848012    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.848054    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.848089    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.848133    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.850411    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:02.927555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.850481    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.948832    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"]
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.948900    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.950517    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.950579    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.950611    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.950625    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.951985    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.952099    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.952127    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.953269    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.953302    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.953317    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.954504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.954528    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.959043    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.959087    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.959098    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.959488    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.959511    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:02.959521    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeHasSufficientPID"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.990446    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-11.ec2.internal\" not found" node="ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:02.994224    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-11.ec2.internal\" not found" node="ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.379836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75c2663eec2141df3d5c4f1c1932094d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-11.ec2.internal\" (UID: \"75c2663eec2141df3d5c4f1c1932094d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.379860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/306925b23e88a76b5c0fed85f97a3a0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal\" (UID: \"306925b23e88a76b5c0fed85f97a3a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.379877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/306925b23e88a76b5c0fed85f97a3a0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal\" (UID: \"306925b23e88a76b5c0fed85f97a3a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.409811 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.387521    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.480453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75c2663eec2141df3d5c4f1c1932094d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-11.ec2.internal\" (UID: \"75c2663eec2141df3d5c4f1c1932094d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.480497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/306925b23e88a76b5c0fed85f97a3a0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal\" (UID: \"306925b23e88a76b5c0fed85f97a3a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.480514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/306925b23e88a76b5c0fed85f97a3a0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal\" (UID: \"306925b23e88a76b5c0fed85f97a3a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.480553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/75c2663eec2141df3d5c4f1c1932094d-config\") pod \"kube-apiserver-proxy-ip-10-0-142-11.ec2.internal\" (UID: \"75c2663eec2141df3d5c4f1c1932094d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.480564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/306925b23e88a76b5c0fed85f97a3a0d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal\" (UID: \"306925b23e88a76b5c0fed85f97a3a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.480564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/306925b23e88a76b5c0fed85f97a3a0d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal\" (UID: \"306925b23e88a76b5c0fed85f97a3a0d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.558173 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.488552    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:04.687191 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.589143    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:04.687191 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.629324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.687191 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.632967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:04.829094 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.689855    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:04.829094 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.790355    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-11.ec2.internal\" not found"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.878408    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.910232    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.910368    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.910399    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.948179    2577 apiserver.go:52] "Watching apiserver"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.963882    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.965670    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-z2fwz","openshift-image-registry/node-ca-fwpb4","openshift-multus/network-metrics-daemon-vlk5d","openshift-network-diagnostics/network-check-target-5g67g","openshift-ovn-kubernetes/ovnkube-node-wr2q7","kube-system/global-pull-secret-syncer-zj2d5","kube-system/konnectivity-agent-lxf94","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8","openshift-cluster-node-tuning-operator/tuned-j6g6n","openshift-multus/multus-9k8n7","openshift-multus/multus-additional-cni-plugins-7jbcn","openshift-network-operator/iptables-alerter-v87cd"]
Jul 21 16:25:04.972785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.966969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.974528    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.975290    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.975463    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.975679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.975840    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mgvjg\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.975873    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.977414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.977485    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.978496    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.978572    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.978597    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.978641    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.978799    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pwjt5\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.978904    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.979912    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.980928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:04.980974    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.981646    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.981699    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dlrxd\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.981730    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.981895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.982081    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.982337    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.982400    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.982426    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 16:25:05.102085 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.982975    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b333731c-1774-409a-ab2a-871be05605f0-tmp-dir\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-serviceca\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983224    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59w74\" (UniqueName: \"kubernetes.io/projected/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-kube-api-access-59w74\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b333731c-1774-409a-ab2a-871be05605f0-hosts-file\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfkgl\" (UniqueName: \"kubernetes.io/projected/b333731c-1774-409a-ab2a-871be05605f0-kube-api-access-jfkgl\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983314    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-host\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983635    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fqvxs\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983744    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.983995    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.984195    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.984577    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.984670    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qwc5p\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.984764    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.985491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.986232    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.986445    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.986551    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.986804    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vtrrl\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.986913    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.987211    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hcp6m\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.987409    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.987756    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.987850    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.988088    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 16:25:05.104332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.988295    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.988392    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.988473    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.989449    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zcsrq\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.989673    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.989931    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.990093    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.990238    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal"]
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.990250    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.990440    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bkf5d\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.990497    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.990569    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.994624    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:20:03 +0000 UTC" deadline="2028-01-05 14:24:31.665144807 +0000 UTC"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.994646    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12789h59m26.670500668s"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.994796    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal"]
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:04.994946    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.017791    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvzsc"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.024561    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fvzsc"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.076184    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c68da2e2-8783-4513-b274-2cd3bbef0595-host-slash\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-modprobe-d\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22vzd\" (UniqueName: \"kubernetes.io/projected/a511c138-f17c-436e-963c-ff757b80309a-kube-api-access-22vzd\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.105866 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-run-netns\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084351    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovnkube-script-lib\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-k8s-cni-cncf-io\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-daemon-config\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpgzw\" (UniqueName: \"kubernetes.io/projected/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-kube-api-access-jpgzw\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084472    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-systemd\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-etc-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-device-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj9gc\" (UniqueName: \"kubernetes.io/projected/71216f65-7556-4e60-8a4a-9710301c0022-kube-api-access-jj9gc\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084582    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysctl-d\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084602    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-systemd-units\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-node-log\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44b00610-6fbb-4ced-b5ea-cb62b05b1314-cni-binary-copy\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.107939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084676    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-hostroot\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42c8fef1-c834-469a-8e1a-4dfde18f51c1-kubelet-config\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-etc-selinux\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovn-node-metrics-cert\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c68da2e2-8783-4513-b274-2cd3bbef0595-iptables-alerter-script\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084845    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a511c138-f17c-436e-963c-ff757b80309a-etc-tuned\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3490ff45-587c-42be-9677-734c4a4f58c2-agent-certs\") pod \"konnectivity-agent-lxf94\" (UID: \"3490ff45-587c-42be-9677-734c4a4f58c2\") " pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-system-cni-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.084984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3490ff45-587c-42be-9677-734c4a4f58c2-konnectivity-ca\") pod \"konnectivity-agent-lxf94\" (UID: \"3490ff45-587c-42be-9677-734c4a4f58c2\") " pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-conf-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.108591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-sys-fs\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085132    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysconfig\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-run\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-var-lib-kubelet\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xskc\" (UniqueName: \"kubernetes.io/projected/c68da2e2-8783-4513-b274-2cd3bbef0595-kube-api-access-7xskc\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59w74\" (UniqueName: \"kubernetes.io/projected/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-kube-api-access-59w74\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085246    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-lib-modules\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-host\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a511c138-f17c-436e-963c-ff757b80309a-tmp\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-ovn\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085331    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-env-overrides\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-cni-multus\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085381    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.109673 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-kubernetes\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085449    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-cni-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-socket-dir-parent\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085516    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-netns\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-system-cni-dir\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42c8fef1-c834-469a-8e1a-4dfde18f51c1-dbus\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-socket-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-registration-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-sys\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6gs\" (UniqueName: \"kubernetes.io/projected/04905b25-566b-4f4d-8d8f-61b68d8976ad-kube-api-access-kk6gs\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-etc-kubernetes\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjdz\" (UniqueName: \"kubernetes.io/projected/ca635a90-6026-4166-9b29-8c4224ad1f16-kube-api-access-tmjdz\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b333731c-1774-409a-ab2a-871be05605f0-hosts-file\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.110346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085799    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfkgl\" (UniqueName: \"kubernetes.io/projected/b333731c-1774-409a-ab2a-871be05605f0-kube-api-access-jfkgl\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b333731c-1774-409a-ab2a-871be05605f0-tmp-dir\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-kubelet\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085849    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-log-socket\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-cni-bin\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085882    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b333731c-1774-409a-ab2a-871be05605f0-hosts-file\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.085959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-cni-netd\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-os-release\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-os-release\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysctl-conf\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-systemd\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-var-lib-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovnkube-config\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-multus-certs\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.111443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-serviceca\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086267    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-slash\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086279    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b333731c-1774-409a-ab2a-871be05605f0-tmp-dir\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-cni-bin\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-kubelet\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-cni-binary-copy\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-host\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-cnibin\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8tm\" (UniqueName: \"kubernetes.io/projected/44b00610-6fbb-4ced-b5ea-cb62b05b1314-kube-api-access-8r8tm\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-cnibin\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086561    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-host\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.086629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-serviceca\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.091375    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 16:25:05.113047 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.094483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59w74\" (UniqueName: \"kubernetes.io/projected/e2a2dec2-d5bf-403b-befd-3d73a1b7bd30-kube-api-access-59w74\") pod \"node-ca-fwpb4\" (UID: \"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30\") " pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.113726 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.094537    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfkgl\" (UniqueName: \"kubernetes.io/projected/b333731c-1774-409a-ab2a-871be05605f0-kube-api-access-jfkgl\") pod \"node-resolver-z2fwz\" (UID: \"b333731c-1774-409a-ab2a-871be05605f0\") " pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.136268 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.136243    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:05.186812 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.186766    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod306925b23e88a76b5c0fed85f97a3a0d.slice/crio-308ccd53ae2e811250715101a08e08d53d54d8f74fdb0d52794ee660ae9ab690 WatchSource:0}: Error finding container 308ccd53ae2e811250715101a08e08d53d54d8f74fdb0d52794ee660ae9ab690: Status 404 returned error can't find the container with id 308ccd53ae2e811250715101a08e08d53d54d8f74fdb0d52794ee660ae9ab690
Jul 21 16:25:05.186937 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-kubelet\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.186937 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-log-socket\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.186937 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-cni-bin\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.186937 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-cni-netd\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-cni-netd\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-log-socket\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.186990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-kubelet\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-cni-bin\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-os-release\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-os-release\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysctl-conf\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187107    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-systemd\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-var-lib-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-os-release\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187177 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovnkube-config\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysctl-conf\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187209    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-systemd\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187206    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-os-release\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-var-lib-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-multus-certs\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-slash\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-multus-certs\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-cni-bin\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-slash\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-kubelet\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-cni-bin\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-kubelet\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187374    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-cni-binary-copy\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:05.187724 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-cnibin\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8tm\" (UniqueName: \"kubernetes.io/projected/44b00610-6fbb-4ced-b5ea-cb62b05b1314-kube-api-access-8r8tm\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-cnibin\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c68da2e2-8783-4513-b274-2cd3bbef0595-host-slash\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-cnibin\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-modprobe-d\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-cnibin\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22vzd\" (UniqueName: \"kubernetes.io/projected/a511c138-f17c-436e-963c-ff757b80309a-kube-api-access-22vzd\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c68da2e2-8783-4513-b274-2cd3bbef0595-host-slash\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-run-netns\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovnkube-script-lib\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovnkube-config\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-k8s-cni-cncf-io\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.188528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187725    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-modprobe-d\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.187743    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-k8s-cni-cncf-io\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.187823    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:25:05.687783267 +0000 UTC m=+2.028703129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-daemon-config\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187863    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpgzw\" (UniqueName: \"kubernetes.io/projected/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-kube-api-access-jpgzw\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-systemd\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-etc-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187919    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-cni-binary-copy\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-device-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-run-netns\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj9gc\" (UniqueName: \"kubernetes.io/projected/71216f65-7556-4e60-8a4a-9710301c0022-kube-api-access-jj9gc\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.189321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.187995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-etc-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188009    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysctl-d\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-systemd-units\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-node-log\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44b00610-6fbb-4ced-b5ea-cb62b05b1314-cni-binary-copy\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188101    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-hostroot\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-hostroot\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42c8fef1-c834-469a-8e1a-4dfde18f51c1-kubelet-config\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188187    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysctl-d\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/42c8fef1-c834-469a-8e1a-4dfde18f51c1-kubelet-config\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-etc-selinux\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-etc-selinux\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-systemd\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovnkube-script-lib\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-daemon-config\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovn-node-metrics-cert\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-systemd-units\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-node-log\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c68da2e2-8783-4513-b274-2cd3bbef0595-iptables-alerter-script\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-device-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188340    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a511c138-f17c-436e-963c-ff757b80309a-etc-tuned\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3490ff45-587c-42be-9677-734c4a4f58c2-agent-certs\") pod \"konnectivity-agent-lxf94\" (UID: \"3490ff45-587c-42be-9677-734c4a4f58c2\") " pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-system-cni-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3490ff45-587c-42be-9677-734c4a4f58c2-konnectivity-ca\") pod \"konnectivity-agent-lxf94\" (UID: \"3490ff45-587c-42be-9677-734c4a4f58c2\") " pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.190768 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-conf-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-sys-fs\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysconfig\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-run\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.188638    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c2663eec2141df3d5c4f1c1932094d.slice/crio-7610e1a0ca8dde6cca97b71906604461a25acd3918dcd6e8f1306b8e7c770e61 WatchSource:0}: Error finding container 7610e1a0ca8dde6cca97b71906604461a25acd3918dcd6e8f1306b8e7c770e61: Status 404 returned error can't find the container with id 7610e1a0ca8dde6cca97b71906604461a25acd3918dcd6e8f1306b8e7c770e61
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-var-lib-kubelet\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xskc\" (UniqueName: \"kubernetes.io/projected/c68da2e2-8783-4513-b274-2cd3bbef0595-kube-api-access-7xskc\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-conf-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-lib-modules\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188717    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44b00610-6fbb-4ced-b5ea-cb62b05b1314-cni-binary-copy\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-host\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a511c138-f17c-436e-963c-ff757b80309a-tmp\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191444 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-ovn\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188803    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-env-overrides\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c68da2e2-8783-4513-b274-2cd3bbef0595-iptables-alerter-script\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-cni-multus\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-openvswitch\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-kubernetes\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-cni-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-system-cni-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-socket-dir-parent\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-var-lib-cni-multus\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-netns\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-system-cni-dir\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.188987    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-host\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42c8fef1-c834-469a-8e1a-4dfde18f51c1-dbus\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.191882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-socket-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-registration-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-sys\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189156    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6gs\" (UniqueName: \"kubernetes.io/projected/04905b25-566b-4f4d-8d8f-61b68d8976ad-kube-api-access-kk6gs\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-socket-dir-parent\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-etc-kubernetes\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjdz\" (UniqueName: \"kubernetes.io/projected/ca635a90-6026-4166-9b29-8c4224ad1f16-kube-api-access-tmjdz\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-sysconfig\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-run-ovn\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-lib-modules\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/04905b25-566b-4f4d-8d8f-61b68d8976ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/42c8fef1-c834-469a-8e1a-4dfde18f51c1-dbus\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-sys-fs\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.192524 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.189513    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189549    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-var-lib-kubelet\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-socket-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.189589    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:05.689572936 +0000 UTC m=+2.030492781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189593    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71216f65-7556-4e60-8a4a-9710301c0022-registration-dir\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189602    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-host-run-netns\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca635a90-6026-4166-9b29-8c4224ad1f16-system-cni-dir\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca635a90-6026-4166-9b29-8c4224ad1f16-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-etc-kubernetes\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-etc-kubernetes\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-sys\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44b00610-6fbb-4ced-b5ea-cb62b05b1314-multus-cni-dir\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a511c138-f17c-436e-963c-ff757b80309a-run\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.189983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/04905b25-566b-4f4d-8d8f-61b68d8976ad-env-overrides\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.193279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.190427    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3490ff45-587c-42be-9677-734c4a4f58c2-konnectivity-ca\") pod \"konnectivity-agent-lxf94\" (UID: \"3490ff45-587c-42be-9677-734c4a4f58c2\") " pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.194194 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.191094    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a511c138-f17c-436e-963c-ff757b80309a-etc-tuned\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.194194 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.191418    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a511c138-f17c-436e-963c-ff757b80309a-tmp\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.194194 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.191527    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3490ff45-587c-42be-9677-734c4a4f58c2-agent-certs\") pod \"konnectivity-agent-lxf94\" (UID: \"3490ff45-587c-42be-9677-734c4a4f58c2\") " pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.194194 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.191801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/04905b25-566b-4f4d-8d8f-61b68d8976ad-ovn-node-metrics-cert\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.194194 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.193431    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:25:05.197965 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.197947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22vzd\" (UniqueName: \"kubernetes.io/projected/a511c138-f17c-436e-963c-ff757b80309a-kube-api-access-22vzd\") pod \"tuned-j6g6n\" (UID: \"a511c138-f17c-436e-963c-ff757b80309a\") " pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.199760 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.199717    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:05.199760 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.199741    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:05.199896 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.199765    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:05.199896 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.199833    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:05.699815553 +0000 UTC m=+2.040735398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:05.200781 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.200760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8tm\" (UniqueName: \"kubernetes.io/projected/44b00610-6fbb-4ced-b5ea-cb62b05b1314-kube-api-access-8r8tm\") pod \"multus-9k8n7\" (UID: \"44b00610-6fbb-4ced-b5ea-cb62b05b1314\") " pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.201247 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.201225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6gs\" (UniqueName: \"kubernetes.io/projected/04905b25-566b-4f4d-8d8f-61b68d8976ad-kube-api-access-kk6gs\") pod \"ovnkube-node-wr2q7\" (UID: \"04905b25-566b-4f4d-8d8f-61b68d8976ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.201894 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.201868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjdz\" (UniqueName: \"kubernetes.io/projected/ca635a90-6026-4166-9b29-8c4224ad1f16-kube-api-access-tmjdz\") pod \"multus-additional-cni-plugins-7jbcn\" (UID: \"ca635a90-6026-4166-9b29-8c4224ad1f16\") " pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.202208 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.202192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xskc\" (UniqueName: \"kubernetes.io/projected/c68da2e2-8783-4513-b274-2cd3bbef0595-kube-api-access-7xskc\") pod \"iptables-alerter-v87cd\" (UID: \"c68da2e2-8783-4513-b274-2cd3bbef0595\") " pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.202927 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.202913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj9gc\" (UniqueName: \"kubernetes.io/projected/71216f65-7556-4e60-8a4a-9710301c0022-kube-api-access-jj9gc\") pod \"aws-ebs-csi-driver-node-rbpc8\" (UID: \"71216f65-7556-4e60-8a4a-9710301c0022\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.203026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.203012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpgzw\" (UniqueName: \"kubernetes.io/projected/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-kube-api-access-jpgzw\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.287299 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.287266    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:05.313184 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.313155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z2fwz"
Jul 21 16:25:05.322135 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.322100    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb333731c_1774_409a_ab2a_871be05605f0.slice/crio-221d85b7e62bf5977bfd664f345fb9e6359c56c95c50cabeebe249acf4ea78c9 WatchSource:0}: Error finding container 221d85b7e62bf5977bfd664f345fb9e6359c56c95c50cabeebe249acf4ea78c9: Status 404 returned error can't find the container with id 221d85b7e62bf5977bfd664f345fb9e6359c56c95c50cabeebe249acf4ea78c9
Jul 21 16:25:05.338193 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.338172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fwpb4"
Jul 21 16:25:05.345605 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.345582    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a2dec2_d5bf_403b_befd_3d73a1b7bd30.slice/crio-d52d9333d1a43cfe0670f3f32d61a2c9cfcf14e24967660e049cab47bede9c8e WatchSource:0}: Error finding container d52d9333d1a43cfe0670f3f32d61a2c9cfcf14e24967660e049cab47bede9c8e: Status 404 returned error can't find the container with id d52d9333d1a43cfe0670f3f32d61a2c9cfcf14e24967660e049cab47bede9c8e
Jul 21 16:25:05.361953 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.361902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:05.369167 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.369145    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04905b25_566b_4f4d_8d8f_61b68d8976ad.slice/crio-ce2c47485ed0995e9d9f2a6ae6ccdbc6aff36deef13361cc2c7d6aa0fa2c4c48 WatchSource:0}: Error finding container ce2c47485ed0995e9d9f2a6ae6ccdbc6aff36deef13361cc2c7d6aa0fa2c4c48: Status 404 returned error can't find the container with id ce2c47485ed0995e9d9f2a6ae6ccdbc6aff36deef13361cc2c7d6aa0fa2c4c48
Jul 21 16:25:05.376588 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.376384    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:05.383426 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.383402    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3490ff45_587c_42be_9677_734c4a4f58c2.slice/crio-97d3687c202de279ea233db0c7a38a29d4279e5f75dbf5bb05fa4005725b1cd9 WatchSource:0}: Error finding container 97d3687c202de279ea233db0c7a38a29d4279e5f75dbf5bb05fa4005725b1cd9: Status 404 returned error can't find the container with id 97d3687c202de279ea233db0c7a38a29d4279e5f75dbf5bb05fa4005725b1cd9
Jul 21 16:25:05.430374 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.430337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8"
Jul 21 16:25:05.437682 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.437652    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71216f65_7556_4e60_8a4a_9710301c0022.slice/crio-19d8c3bf4cd1ee704da240dcb2be5e5c286be33d9f84e962e2c1eee86eacfd41 WatchSource:0}: Error finding container 19d8c3bf4cd1ee704da240dcb2be5e5c286be33d9f84e962e2c1eee86eacfd41: Status 404 returned error can't find the container with id 19d8c3bf4cd1ee704da240dcb2be5e5c286be33d9f84e962e2c1eee86eacfd41
Jul 21 16:25:05.448980 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.448961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9k8n7"
Jul 21 16:25:05.450041 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.450026    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6g6n"
Jul 21 16:25:05.451382 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.451366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7jbcn"
Jul 21 16:25:05.454769 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.454751    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v87cd"
Jul 21 16:25:05.459098 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.459074    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44b00610_6fbb_4ced_b5ea_cb62b05b1314.slice/crio-0b9748d91d1277b37a8681d39f52f284603471807c1c41e6e0df73d5e9226096 WatchSource:0}: Error finding container 0b9748d91d1277b37a8681d39f52f284603471807c1c41e6e0df73d5e9226096: Status 404 returned error can't find the container with id 0b9748d91d1277b37a8681d39f52f284603471807c1c41e6e0df73d5e9226096
Jul 21 16:25:05.459821 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.459791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda511c138_f17c_436e_963c_ff757b80309a.slice/crio-69f2964c0950582fcece4ce0478d799e15ea77e335f4d636c48c12ee13cdb771 WatchSource:0}: Error finding container 69f2964c0950582fcece4ce0478d799e15ea77e335f4d636c48c12ee13cdb771: Status 404 returned error can't find the container with id 69f2964c0950582fcece4ce0478d799e15ea77e335f4d636c48c12ee13cdb771
Jul 21 16:25:05.462721 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.462692    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca635a90_6026_4166_9b29_8c4224ad1f16.slice/crio-7b5381c6ced1ef03310eb3e9cb24e80387be525bd93b6d06e782ff6479db3d9e WatchSource:0}: Error finding container 7b5381c6ced1ef03310eb3e9cb24e80387be525bd93b6d06e782ff6479db3d9e: Status 404 returned error can't find the container with id 7b5381c6ced1ef03310eb3e9cb24e80387be525bd93b6d06e782ff6479db3d9e
Jul 21 16:25:05.466052 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:05.466032    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68da2e2_8783_4513_b274_2cd3bbef0595.slice/crio-469f23a7f1b9f59a785dd58299591b612936ff5bbf154b94dc06794c7f705ffd WatchSource:0}: Error finding container 469f23a7f1b9f59a785dd58299591b612936ff5bbf154b94dc06794c7f705ffd: Status 404 returned error can't find the container with id 469f23a7f1b9f59a785dd58299591b612936ff5bbf154b94dc06794c7f705ffd
Jul 21 16:25:05.692788 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.692691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:05.692943 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.692838    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:05.692943 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.692847    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:05.692943 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.692911    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:06.692888785 +0000 UTC m=+3.033808644 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:05.693102 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.692965    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:05.693102 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.693018    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:25:06.693001921 +0000 UTC m=+3.033921763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:05.794109 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.793781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:05.794109 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.793970    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:05.794109 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.793993    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:05.794109 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.794006    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:05.794109 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:05.794066    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:06.794048001 +0000 UTC m=+3.134967853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:05.901054 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:05.901023    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:06.026825 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.026708    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:20:05 +0000 UTC" deadline="2028-01-19 01:42:01.225068309 +0000 UTC"
Jul 21 16:25:06.026825 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.026773    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13113h16m55.19829977s"
Jul 21 16:25:06.185480 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.185449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:06.185661 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.185589    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:06.196687 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.196535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerStarted","Data":"7b5381c6ced1ef03310eb3e9cb24e80387be525bd93b6d06e782ff6479db3d9e"}
Jul 21 16:25:06.199445 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.199413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8" event={"ID":"71216f65-7556-4e60-8a4a-9710301c0022","Type":"ContainerStarted","Data":"19d8c3bf4cd1ee704da240dcb2be5e5c286be33d9f84e962e2c1eee86eacfd41"}
Jul 21 16:25:06.204884 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.204812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxf94" event={"ID":"3490ff45-587c-42be-9677-734c4a4f58c2","Type":"ContainerStarted","Data":"97d3687c202de279ea233db0c7a38a29d4279e5f75dbf5bb05fa4005725b1cd9"}
Jul 21 16:25:06.208186 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.208099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwpb4" event={"ID":"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30","Type":"ContainerStarted","Data":"d52d9333d1a43cfe0670f3f32d61a2c9cfcf14e24967660e049cab47bede9c8e"}
Jul 21 16:25:06.219081 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.219049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v87cd" event={"ID":"c68da2e2-8783-4513-b274-2cd3bbef0595","Type":"ContainerStarted","Data":"469f23a7f1b9f59a785dd58299591b612936ff5bbf154b94dc06794c7f705ffd"}
Jul 21 16:25:06.236508 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.236475    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6g6n" event={"ID":"a511c138-f17c-436e-963c-ff757b80309a","Type":"ContainerStarted","Data":"69f2964c0950582fcece4ce0478d799e15ea77e335f4d636c48c12ee13cdb771"}
Jul 21 16:25:06.247531 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.247435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9k8n7" event={"ID":"44b00610-6fbb-4ced-b5ea-cb62b05b1314","Type":"ContainerStarted","Data":"0b9748d91d1277b37a8681d39f52f284603471807c1c41e6e0df73d5e9226096"}
Jul 21 16:25:06.268349 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.268314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"ce2c47485ed0995e9d9f2a6ae6ccdbc6aff36deef13361cc2c7d6aa0fa2c4c48"}
Jul 21 16:25:06.281741 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.281668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2fwz" event={"ID":"b333731c-1774-409a-ab2a-871be05605f0","Type":"ContainerStarted","Data":"221d85b7e62bf5977bfd664f345fb9e6359c56c95c50cabeebe249acf4ea78c9"}
Jul 21 16:25:06.284696 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.284667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal" event={"ID":"75c2663eec2141df3d5c4f1c1932094d","Type":"ContainerStarted","Data":"7610e1a0ca8dde6cca97b71906604461a25acd3918dcd6e8f1306b8e7c770e61"}
Jul 21 16:25:06.299954 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.299888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal" event={"ID":"306925b23e88a76b5c0fed85f97a3a0d","Type":"ContainerStarted","Data":"308ccd53ae2e811250715101a08e08d53d54d8f74fdb0d52794ee660ae9ab690"}
Jul 21 16:25:06.701152 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.701049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:06.701152 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.701106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:06.701375 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.701236    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:06.701375 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.701290    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:08.701272793 +0000 UTC m=+5.042192641 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:06.701679 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.701660    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:06.701777 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.701713    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:25:08.701696401 +0000 UTC m=+5.042616251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:06.802373 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:06.801707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:06.802373 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.801910    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:06.802373 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.801929    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:06.802373 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.801942    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:06.802373 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:06.801998    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:08.801980919 +0000 UTC m=+5.142900766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:07.027462 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:07.027373    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:20:05 +0000 UTC" deadline="2028-04-21 04:01:35.050426796 +0000 UTC"
Jul 21 16:25:07.027462 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:07.027411    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15347h36m28.023020474s"
Jul 21 16:25:07.188357 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:07.188321    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:07.188524 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:07.188456    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:07.188592 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:07.188570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:07.188756 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:07.188733    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:08.110570 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:08.110356    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 16:25:08.188205 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:08.187703    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:08.188205 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.187830    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:08.718831 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:08.718794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:08.719003 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:08.718893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:08.719065 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.719031    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:08.719159 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.719139    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:25:12.719075283 +0000 UTC m=+9.059995142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:08.719796 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.719538    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:08.719796 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.719590    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:12.719575716 +0000 UTC m=+9.060495559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:08.820577 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:08.820100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:08.820577 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.820380    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:08.820577 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.820400    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:08.820577 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.820413    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:08.820577 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:08.820478    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:12.820458169 +0000 UTC m=+9.161378012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:09.185176 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:09.185036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:09.185604 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:09.185201    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:09.185604 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:09.185248    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:09.185604 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:09.185377    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:10.184751 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:10.184719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:10.184906 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:10.184862    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:11.184874 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:11.184833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:11.185339 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:11.184886    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:11.185339 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:11.184981    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:11.185339 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:11.185136    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:12.185214 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:12.184719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:12.185214 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.184843    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:12.754862 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:12.754820    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:12.755155 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:12.754915    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:12.755155 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.755047    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:12.755155 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.755111    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:25:20.755091903 +0000 UTC m=+17.096011764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:12.755332 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.755166    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:12.755332 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.755211    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:20.755199114 +0000 UTC m=+17.096118959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:12.856564 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:12.856113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:12.856564 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.856312    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:12.856564 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.856336    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:12.856564 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.856349    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:12.856564 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:12.856407    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:20.856388518 +0000 UTC m=+17.197308362 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:13.185191 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:13.185048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:13.185191 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:13.185086    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:13.185721 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:13.185196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:13.185721 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:13.185327    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:14.185656 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:14.185623    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:14.186143 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:14.185738    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:15.184933 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:15.184899    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:15.184933 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:15.184937    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:15.185166 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:15.185044    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:15.185166 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:15.185112    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:16.184402 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:16.184371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:16.184873 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:16.184495    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:17.184575 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:17.184543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:17.184995 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:17.184543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:17.184995 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:17.184661    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:17.184995 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:17.184756    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:18.184717 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:18.184513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:18.185135 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:18.184807    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:19.185378 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:19.185337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:19.185745 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:19.185405    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:19.185745 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:19.185531    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:19.185745 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:19.185681    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:20.184711 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:20.184668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:20.184895 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.184804    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:20.820674 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:20.820635    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:20.821176 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:20.820722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:20.821176 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.820834    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:20.821176 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.820912    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:36.820892861 +0000 UTC m=+33.161812706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:20.821176 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.820841    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:20.821176 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.821016    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:25:36.820994079 +0000 UTC m=+33.161913932 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:20.921459 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:20.921418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:20.921647 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.921609    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:20.921647 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.921639    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:20.921757 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.921656    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:20.921757 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:20.921715    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:36.921696957 +0000 UTC m=+33.262616800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:21.185149 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:21.185047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:21.185325 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:21.185047    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:21.185325 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:21.185196    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:21.185325 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:21.185290    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:22.185011 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:22.184976    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:22.185470 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:22.185115    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:23.184582 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:23.184454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:23.184582 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:23.184487    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:23.184809 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:23.184596    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:23.184809 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:23.184792    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:24.188296 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:24.185861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:24.188296 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:24.186170    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:25.184595 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:25.184562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:25.184712 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:25.184692    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:25.184772 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:25.184740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:25.184880 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:25.184861    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:25.347923 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:25.347892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6g6n" event={"ID":"a511c138-f17c-436e-963c-ff757b80309a","Type":"ContainerStarted","Data":"5de1fb021523662f94c236a06dd654189d2f4f3d5d46bf58259fec602853eba8"}
Jul 21 16:25:25.349315 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:25.349294    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9k8n7" event={"ID":"44b00610-6fbb-4ced-b5ea-cb62b05b1314","Type":"ContainerStarted","Data":"20e934e2e4976a1b2f902619038a710079c546525ee7a5dfd56e2a7ece65c582"}
Jul 21 16:25:25.350647 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:25.350622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal" event={"ID":"75c2663eec2141df3d5c4f1c1932094d","Type":"ContainerStarted","Data":"d5eb50f579b77b84a23d8f6234158bfc15b5d601eab67b1e34abe1c6eaa1851b"}
Jul 21 16:25:25.390566 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:25.390524    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j6g6n" podStartSLOduration=1.780967976 podStartE2EDuration="21.390510729s" totalImagesPullingTime="19.609542753s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:25.366510396 +0000 UTC m=+21.707430259" watchObservedRunningTime="2026-07-21 16:25:25.390510729 +0000 UTC m=+21.731430592"
Jul 21 16:25:26.185437 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.185213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:26.185560 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:26.185539    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:26.355101 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355002    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355370    2577 generic.go:356] "Generic (PLEG): container finished" podID="04905b25-566b-4f4d-8d8f-61b68d8976ad" containerID="248c0144a22d323c832b0471b1ca2791305afffcd30bfc8773ee8679691bb218" exitCode=1
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"04af3918c38312ea471d01fc43bfd5f2aabdc36e2f3ac9b4fdf4110a1b303150"}
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355531    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"b6968b0baa0408a78344f59110cc1fc2618d0b4440139ca3ad10fab48f095b06"}
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"b764cdff98092296e9bd992a03e549e05d46bd2c75036aab303b5e9b4c93c6ee"}
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"55f9f8aeee06fc7508792b653c3c68a843ae96bd72a31e3c6659b5a91104354b"}
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355655    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerDied","Data":"248c0144a22d323c832b0471b1ca2791305afffcd30bfc8773ee8679691bb218"}
Jul 21 16:25:26.355951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.355703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"4ae4471c771c568ab511e5c9c3eceed971ecf567ca378e52008c826a7bf012cd"}
Jul 21 16:25:26.356865 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.356843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z2fwz" event={"ID":"b333731c-1774-409a-ab2a-871be05605f0","Type":"ContainerStarted","Data":"a2f5077efcea9a9ea7325efc0a8cbd72296f74b28d976684d0fb0486d3c1891b"}
Jul 21 16:25:26.358357 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.358330    2577 generic.go:356] "Generic (PLEG): container finished" podID="306925b23e88a76b5c0fed85f97a3a0d" containerID="f6b0c14c947d3646dec8035f2227df216a76bd00207ddad4f58860b70efa93bb" exitCode=0
Jul 21 16:25:26.358461 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.358401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal" event={"ID":"306925b23e88a76b5c0fed85f97a3a0d","Type":"ContainerDied","Data":"f6b0c14c947d3646dec8035f2227df216a76bd00207ddad4f58860b70efa93bb"}
Jul 21 16:25:26.359818 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.359793    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca635a90-6026-4166-9b29-8c4224ad1f16" containerID="9944519b107cf34a774a60d47fecaa821ad854978469bc8ab522cdddd52b26b9" exitCode=0
Jul 21 16:25:26.359931 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.359876    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerDied","Data":"9944519b107cf34a774a60d47fecaa821ad854978469bc8ab522cdddd52b26b9"}
Jul 21 16:25:26.361397 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.361380    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8" event={"ID":"71216f65-7556-4e60-8a4a-9710301c0022","Type":"ContainerStarted","Data":"0ba5308d2f34d06e6c944142812d648b00e0d86b3e8e6be8f1930d117cd0053b"}
Jul 21 16:25:26.362786 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.362767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lxf94" event={"ID":"3490ff45-587c-42be-9677-734c4a4f58c2","Type":"ContainerStarted","Data":"439929f926fa28f380f91977ae180be7c0ac9c46b1862bbeb5453483b25b68f9"}
Jul 21 16:25:26.364214 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.364190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fwpb4" event={"ID":"e2a2dec2-d5bf-403b-befd-3d73a1b7bd30","Type":"ContainerStarted","Data":"6202d762387a0dc78e2fe93554b870736f2ddff2cce4bea586dbda03c2f434cd"}
Jul 21 16:25:26.371645 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.371607    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z2fwz" podStartSLOduration=2.6260310650000003 podStartE2EDuration="22.371595833s" totalImagesPullingTime="19.745564768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:26.371288646 +0000 UTC m=+22.712208520" watchObservedRunningTime="2026-07-21 16:25:26.371595833 +0000 UTC m=+22.712515696"
Jul 21 16:25:26.371897 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.371871    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-11.ec2.internal" podStartSLOduration=22.371866484 podStartE2EDuration="22.371866484s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:25.390503651 +0000 UTC m=+21.731423513" watchObservedRunningTime="2026-07-21 16:25:26.371866484 +0000 UTC m=+22.712786347"
Jul 21 16:25:26.385424 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.385392    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lxf94" podStartSLOduration=2.725278993 podStartE2EDuration="22.385380875s" totalImagesPullingTime="19.660101882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:26.385076871 +0000 UTC m=+22.725996733" watchObservedRunningTime="2026-07-21 16:25:26.385380875 +0000 UTC m=+22.726300737"
Jul 21 16:25:26.419217 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.419158    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fwpb4" podStartSLOduration=2.696612839 podStartE2EDuration="22.419140341s" totalImagesPullingTime="19.722527502s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:26.418393836 +0000 UTC m=+22.759313701" watchObservedRunningTime="2026-07-21 16:25:26.419140341 +0000 UTC m=+22.760060204"
Jul 21 16:25:26.436851 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.436802    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9k8n7" podStartSLOduration=2.820090658 podStartE2EDuration="22.436782854s" totalImagesPullingTime="19.616692196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:26.436416643 +0000 UTC m=+22.777336505" watchObservedRunningTime="2026-07-21 16:25:26.436782854 +0000 UTC m=+22.777702718"
Jul 21 16:25:26.540329 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.540296    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:26.541072 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:26.541046    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:27.120302 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.120280    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 16:25:27.184695 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.184665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:27.184856 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.184665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:27.184856 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:27.184778    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:27.184856 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:27.184828    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:27.368450 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.368373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8" event={"ID":"71216f65-7556-4e60-8a4a-9710301c0022","Type":"ContainerStarted","Data":"f8e45e35c350ee511ef9b324f9c75fa53b2fc7713952e686a334ebf42fdb99af"}
Jul 21 16:25:27.369756 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.369734    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v87cd" event={"ID":"c68da2e2-8783-4513-b274-2cd3bbef0595","Type":"ContainerStarted","Data":"80c5e045133d830a8782768e38e5b2a3ed25dcdf440f83cf3f231f030e3a3742"}
Jul 21 16:25:27.371412 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.371382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal" event={"ID":"306925b23e88a76b5c0fed85f97a3a0d","Type":"ContainerStarted","Data":"d85b25047ea8055aa4d8e0fb7c7766577607f8ec770e53b3b2060ee394abc449"}
Jul 21 16:25:27.406997 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.406954    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v87cd" podStartSLOduration=3.805101972 podStartE2EDuration="23.406941582s" totalImagesPullingTime="19.60183961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:27.40671892 +0000 UTC m=+23.747638784" watchObservedRunningTime="2026-07-21 16:25:27.406941582 +0000 UTC m=+23.747861444"
Jul 21 16:25:27.427985 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:27.427948    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-11.ec2.internal" podStartSLOduration=23.42793363 podStartE2EDuration="23.42793363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:27.427600256 +0000 UTC m=+23.768520119" watchObservedRunningTime="2026-07-21 16:25:27.42793363 +0000 UTC m=+23.768853496"
Jul 21 16:25:28.055423 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.055320    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:25:27.120296902Z","UUID":"5370a481-d706-48d3-b9fc-82cb47e924f1","Handler":null,"Name":"","Endpoint":""}
Jul 21 16:25:28.056938 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.056916    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 16:25:28.056938 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.056953    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 16:25:28.184761 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.184729    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:28.184911 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:28.184856    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:28.379078 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.379052    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:25:28.379548 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.379512    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"8d474b5125190c5ec9e858f01e3189d72fc57ec72ead7fd071498e63bc910a86"}
Jul 21 16:25:28.381616 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.381550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8" event={"ID":"71216f65-7556-4e60-8a4a-9710301c0022","Type":"ContainerStarted","Data":"4dd7f2ec3f2f1c7981b1af6beb9d5918c1fb2e7e994ba87585af6a43c37972f8"}
Jul 21 16:25:28.381742 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.381679    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 21 16:25:28.400513 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.400474    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rbpc8" podStartSLOduration=2.707727174 podStartE2EDuration="24.400462956s" totalImagesPullingTime="21.692735782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:28.400354139 +0000 UTC m=+24.741274003" watchObservedRunningTime="2026-07-21 16:25:28.400462956 +0000 UTC m=+24.741382850"
Jul 21 16:25:28.556467 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.556433    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:28.557168 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:28.557145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lxf94"
Jul 21 16:25:29.184547 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:29.184514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:29.184712 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:29.184621    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:29.184712 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:29.184666    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:29.184800 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:29.184752    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:30.184964 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:30.184928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:30.185406 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:30.185051    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:31.184360 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.184332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:31.184360 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.184357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:31.184541 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:31.184439    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:31.184541 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:31.184505    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:31.392307 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.392278    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:25:31.393164 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.392697    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"4c28a7b0d6827dfb08c47d5b9672dd4f30f65b73a1de23dc15a2e543c9965f70"}
Jul 21 16:25:31.393164 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.393044    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:31.393293 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.393253    2577 scope.go:117] "RemoveContainer" containerID="248c0144a22d323c832b0471b1ca2791305afffcd30bfc8773ee8679691bb218"
Jul 21 16:25:31.412048 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:31.412028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:32.185367 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.185183    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:32.185523 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:32.185443    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:32.400641 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.400559    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:25:32.401091 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.400953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" event={"ID":"04905b25-566b-4f4d-8d8f-61b68d8976ad","Type":"ContainerStarted","Data":"52db417968469460194f8742a0b9f5d0f9a43c8f80bf0ec67e888fe7d9e11d52"}
Jul 21 16:25:32.401265 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.401242    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:32.401385 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.401312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:32.402774 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.402743    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca635a90-6026-4166-9b29-8c4224ad1f16" containerID="cdd3b99253122816002b4fdc6bf63bc80c213782b4c22126e3195ed947b88bc1" exitCode=0
Jul 21 16:25:32.402875 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.402772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerDied","Data":"cdd3b99253122816002b4fdc6bf63bc80c213782b4c22126e3195ed947b88bc1"}
Jul 21 16:25:32.418854 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.418761    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:25:32.425872 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:32.425831    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7" podStartSLOduration=8.323058136 podStartE2EDuration="28.425818742s" totalImagesPullingTime="20.102760606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:32.425417451 +0000 UTC m=+28.766337313" watchObservedRunningTime="2026-07-21 16:25:32.425818742 +0000 UTC m=+28.766738605"
Jul 21 16:25:33.185184 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.185154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:33.185351 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.185154    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:33.185351 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:33.185259    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:33.185420 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:33.185385    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:33.284486 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.284455    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zj2d5"]
Jul 21 16:25:33.287862 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.287834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vlk5d"]
Jul 21 16:25:33.288389 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.288367    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5g67g"]
Jul 21 16:25:33.288519 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.288466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:33.288580 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:33.288547    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:33.404566 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.404505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:33.404950 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:33.404505    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:33.404950 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:33.404622    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:33.404950 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:33.404679    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:34.408957 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:34.408916    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca635a90-6026-4166-9b29-8c4224ad1f16" containerID="658a8159cece962a60864f5171dd6c5c7e70dc126a297312f5ff05580d6f6f9a" exitCode=0
Jul 21 16:25:34.409361 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:34.408999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerDied","Data":"658a8159cece962a60864f5171dd6c5c7e70dc126a297312f5ff05580d6f6f9a"}
Jul 21 16:25:35.184810 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:35.184598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:35.184942 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:35.184653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:35.184942 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:35.184849    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:35.184942 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:35.184654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:35.184942 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:35.184915    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:35.185093 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:35.185010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:36.418776 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:36.418744    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca635a90-6026-4166-9b29-8c4224ad1f16" containerID="53c23fc921868669529d36621794789f5a4a2f6d87d623cbaae13a2fab54b662" exitCode=0
Jul 21 16:25:36.419157 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:36.418800    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerDied","Data":"53c23fc921868669529d36621794789f5a4a2f6d87d623cbaae13a2fab54b662"}
Jul 21 16:25:36.840609 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:36.840505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:36.840609 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:36.840557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:36.840813 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.840679    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:36.840813 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.840679    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:36.840813 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.840742    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret podName:42c8fef1-c834-469a-8e1a-4dfde18f51c1 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:08.840726674 +0000 UTC m=+65.181646534 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret") pod "global-pull-secret-syncer-zj2d5" (UID: "42c8fef1-c834-469a-8e1a-4dfde18f51c1") : object "kube-system"/"original-pull-secret" not registered
Jul 21 16:25:36.840813 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.840798    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs podName:244a9624-c0ce-4e4e-b22b-91d489bb2a9a nodeName:}" failed. No retries permitted until 2026-07-21 16:26:08.840774338 +0000 UTC m=+65.181694191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs") pod "network-metrics-daemon-vlk5d" (UID: "244a9624-c0ce-4e4e-b22b-91d489bb2a9a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 16:25:36.941411 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:36.941375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:36.941571 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.941517    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 16:25:36.941571 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.941533    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 16:25:36.941571 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.941543    2577 projected.go:196] Error preparing data for projected volume kube-api-access-7v794 for pod openshift-network-diagnostics/network-check-target-5g67g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:36.941708 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:36.941596    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794 podName:9033619e-eb09-4b78-9a93-3967b54301d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:08.941581229 +0000 UTC m=+65.282501087 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7v794" (UniqueName: "kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794") pod "network-check-target-5g67g" (UID: "9033619e-eb09-4b78-9a93-3967b54301d5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 16:25:37.185400 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:37.185324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:37.185555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:37.185427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:37.185555 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:37.185442    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zj2d5" podUID="42c8fef1-c834-469a-8e1a-4dfde18f51c1"
Jul 21 16:25:37.185555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:37.185472    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:37.185723 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:37.185563    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vlk5d" podUID="244a9624-c0ce-4e4e-b22b-91d489bb2a9a"
Jul 21 16:25:37.185723 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:37.185633    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5g67g" podUID="9033619e-eb09-4b78-9a93-3967b54301d5"
Jul 21 16:25:38.312224 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:38.312196    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2fwz_b333731c-1774-409a-ab2a-871be05605f0/dns-node-resolver/0.log"
Jul 21 16:25:38.887647 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:38.887610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwpb4_e2a2dec2-d5bf-403b-befd-3d73a1b7bd30/node-ca/0.log"
Jul 21 16:25:39.019276 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.019251    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-11.ec2.internal" event="NodeReady"
Jul 21 16:25:39.019459 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.019398    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 16:25:39.086495 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.086416    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c56mx"]
Jul 21 16:25:39.088576 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.088544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.090857 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.090772    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qzzv9"]
Jul 21 16:25:39.091843 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.091800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 16:25:39.091843 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.091829    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 16:25:39.092107 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.092092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kw8jm\""
Jul 21 16:25:39.092187 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.092168    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 16:25:39.092877 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.092856    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.096395 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.096372    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 16:25:39.096633 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.096617    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 16:25:39.096785 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.096770    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 16:25:39.099633 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.099613    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-q7w2v\""
Jul 21 16:25:39.099726 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.099647    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 16:25:39.105015 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.104993    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c56mx"]
Jul 21 16:25:39.109776 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.109752    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qzzv9"]
Jul 21 16:25:39.113079 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.113062    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xzhjt"]
Jul 21 16:25:39.114945 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.114927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.118330 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.118312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 16:25:39.118441 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.118353    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 16:25:39.123202 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.123186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4z2m2\""
Jul 21 16:25:39.136902 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.136871    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzhjt"]
Jul 21 16:25:39.184550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.184511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:25:39.184550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.184544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:25:39.184789 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.184770    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:25:39.188063 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.188044    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crp4d\""
Jul 21 16:25:39.188483 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.188462    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:25:39.188596 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.188514    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:25:39.188667 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.188598    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrbdq\""
Jul 21 16:25:39.188667 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.188462    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:25:39.189287 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.189268    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:25:39.260367 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dd0c780-6942-4888-8a62-31c132d0e662-crio-socket\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.260528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260377    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rvhv\" (UniqueName: \"kubernetes.io/projected/2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60-kube-api-access-4rvhv\") pod \"ingress-canary-c56mx\" (UID: \"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60\") " pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.260528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6tpz\" (UniqueName: \"kubernetes.io/projected/1dd0c780-6942-4888-8a62-31c132d0e662-kube-api-access-q6tpz\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.260528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.260528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-tmp-dir\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.260528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wcc6\" (UniqueName: \"kubernetes.io/projected/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-kube-api-access-8wcc6\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.260528 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60-cert\") pod \"ingress-canary-c56mx\" (UID: \"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60\") " pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.260727 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260546    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.260727 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dd0c780-6942-4888-8a62-31c132d0e662-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.260727 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-config-volume\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.260727 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.260633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0c780-6942-4888-8a62-31c132d0e662-data-volume\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.361738 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.361738 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-tmp-dir\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.361738 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wcc6\" (UniqueName: \"kubernetes.io/projected/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-kube-api-access-8wcc6\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60-cert\") pod \"ingress-canary-c56mx\" (UID: \"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60\") " pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dd0c780-6942-4888-8a62-31c132d0e662-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.361804    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-config-volume\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0c780-6942-4888-8a62-31c132d0e662-data-volume\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.361879    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls podName:7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b nodeName:}" failed. No retries permitted until 2026-07-21 16:25:39.861857979 +0000 UTC m=+36.202777842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls") pod "dns-default-xzhjt" (UID: "7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dd0c780-6942-4888-8a62-31c132d0e662-crio-socket\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.361996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rvhv\" (UniqueName: \"kubernetes.io/projected/2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60-kube-api-access-4rvhv\") pod \"ingress-canary-c56mx\" (UID: \"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60\") " pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.362033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6tpz\" (UniqueName: \"kubernetes.io/projected/1dd0c780-6942-4888-8a62-31c132d0e662-kube-api-access-q6tpz\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.362111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-tmp-dir\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.362199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1dd0c780-6942-4888-8a62-31c132d0e662-data-volume\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.362390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1dd0c780-6942-4888-8a62-31c132d0e662-crio-socket\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.362544 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.361882    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:39.363152 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.362422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1dd0c780-6942-4888-8a62-31c132d0e662-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.363152 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.362448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-config-volume\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.363152 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.362463    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls podName:1dd0c780-6942-4888-8a62-31c132d0e662 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:39.862446586 +0000 UTC m=+36.203366438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzzv9" (UID: "1dd0c780-6942-4888-8a62-31c132d0e662") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:39.366283 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.366264    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60-cert\") pod \"ingress-canary-c56mx\" (UID: \"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60\") " pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.373312 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.373288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wcc6\" (UniqueName: \"kubernetes.io/projected/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-kube-api-access-8wcc6\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.375038 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.375015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6tpz\" (UniqueName: \"kubernetes.io/projected/1dd0c780-6942-4888-8a62-31c132d0e662-kube-api-access-q6tpz\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.375283 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.375263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rvhv\" (UniqueName: \"kubernetes.io/projected/2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60-kube-api-access-4rvhv\") pod \"ingress-canary-c56mx\" (UID: \"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60\") " pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.402101 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.402081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c56mx"
Jul 21 16:25:39.473340 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.473307    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gdv7q"]
Jul 21 16:25:39.475292 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.475270    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.477441 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.477418    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kt5k6\""
Jul 21 16:25:39.477544 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.477464    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 21 16:25:39.477935 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.477915    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 21 16:25:39.478017 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.477960    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 21 16:25:39.478649 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.478632    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 21 16:25:39.487968 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.487946    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gdv7q"]
Jul 21 16:25:39.563855 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.563827    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29780007-dfc2-4809-abce-660c2cd03c24-signing-cabundle\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.564033 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.563980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8v54\" (UniqueName: \"kubernetes.io/projected/29780007-dfc2-4809-abce-660c2cd03c24-kube-api-access-q8v54\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.564033 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.564027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29780007-dfc2-4809-abce-660c2cd03c24-signing-key\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.665223 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.665137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29780007-dfc2-4809-abce-660c2cd03c24-signing-cabundle\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.665376 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.665232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8v54\" (UniqueName: \"kubernetes.io/projected/29780007-dfc2-4809-abce-660c2cd03c24-kube-api-access-q8v54\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.665376 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.665348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29780007-dfc2-4809-abce-660c2cd03c24-signing-key\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.665955 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.665931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29780007-dfc2-4809-abce-660c2cd03c24-signing-cabundle\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.667950 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.667929    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29780007-dfc2-4809-abce-660c2cd03c24-signing-key\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.676029 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.676007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8v54\" (UniqueName: \"kubernetes.io/projected/29780007-dfc2-4809-abce-660c2cd03c24-kube-api-access-q8v54\") pod \"service-ca-58598695f7-gdv7q\" (UID: \"29780007-dfc2-4809-abce-660c2cd03c24\") " pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.787215 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.787173    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-gdv7q"
Jul 21 16:25:39.866988 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.866955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:39.867178 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:39.867025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:39.867178 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.867103    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:39.867304 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.867191    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:39.867304 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.867231    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls podName:7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b nodeName:}" failed. No retries permitted until 2026-07-21 16:25:40.867215808 +0000 UTC m=+37.208135652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls") pod "dns-default-xzhjt" (UID: "7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:39.867304 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:39.867259    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls podName:1dd0c780-6942-4888-8a62-31c132d0e662 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:40.867241832 +0000 UTC m=+37.208161675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzzv9" (UID: "1dd0c780-6942-4888-8a62-31c132d0e662") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:40.874870 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:40.874609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:40.875521 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:40.874932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:40.875521 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:40.874817    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:40.875521 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:40.875095    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:40.875521 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:40.875151    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls podName:7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b nodeName:}" failed. No retries permitted until 2026-07-21 16:25:42.875110189 +0000 UTC m=+39.216030032 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls") pod "dns-default-xzhjt" (UID: "7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:40.875737 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:40.875570    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls podName:1dd0c780-6942-4888-8a62-31c132d0e662 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:42.875551744 +0000 UTC m=+39.216471595 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzzv9" (UID: "1dd0c780-6942-4888-8a62-31c132d0e662") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:40.934909 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:40.934886    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c56mx"]
Jul 21 16:25:40.939505 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:40.939444    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-gdv7q"]
Jul 21 16:25:40.939745 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:40.939723    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd4b7ca_f2e3_4288_8c3b_1021e84e0c60.slice/crio-e6d9ebe52d287634b64f8c032d99ece7b3942b7050ee6eb898738c57050e0510 WatchSource:0}: Error finding container e6d9ebe52d287634b64f8c032d99ece7b3942b7050ee6eb898738c57050e0510: Status 404 returned error can't find the container with id e6d9ebe52d287634b64f8c032d99ece7b3942b7050ee6eb898738c57050e0510
Jul 21 16:25:40.944191 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:40.943960    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29780007_dfc2_4809_abce_660c2cd03c24.slice/crio-860e26a3f0d6be2449e4d0d339177344d3b76e11c5a7b1cf76a16cdf8d7d9e49 WatchSource:0}: Error finding container 860e26a3f0d6be2449e4d0d339177344d3b76e11c5a7b1cf76a16cdf8d7d9e49: Status 404 returned error can't find the container with id 860e26a3f0d6be2449e4d0d339177344d3b76e11c5a7b1cf76a16cdf8d7d9e49
Jul 21 16:25:41.433581 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:41.433492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gdv7q" event={"ID":"29780007-dfc2-4809-abce-660c2cd03c24","Type":"ContainerStarted","Data":"860e26a3f0d6be2449e4d0d339177344d3b76e11c5a7b1cf76a16cdf8d7d9e49"}
Jul 21 16:25:41.436572 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:41.436545    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca635a90-6026-4166-9b29-8c4224ad1f16" containerID="e7fe3929baf49a85b132dd7b91144e8cd3e211427a53432f6db245915af288e7" exitCode=0
Jul 21 16:25:41.436717 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:41.436632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerDied","Data":"e7fe3929baf49a85b132dd7b91144e8cd3e211427a53432f6db245915af288e7"}
Jul 21 16:25:41.437799 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:41.437775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c56mx" event={"ID":"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60","Type":"ContainerStarted","Data":"e6d9ebe52d287634b64f8c032d99ece7b3942b7050ee6eb898738c57050e0510"}
Jul 21 16:25:42.443981 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:42.443945    2577 generic.go:356] "Generic (PLEG): container finished" podID="ca635a90-6026-4166-9b29-8c4224ad1f16" containerID="b6acfe2047cebeccd0ba5186d7eec1d26d6ed9d5b2422933beba0ad3c27a8b7e" exitCode=0
Jul 21 16:25:42.444490 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:42.444005    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerDied","Data":"b6acfe2047cebeccd0ba5186d7eec1d26d6ed9d5b2422933beba0ad3c27a8b7e"}
Jul 21 16:25:42.892554 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:42.892368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:42.892743 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:42.892596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:42.892743 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:42.892521    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:42.892743 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:42.892699    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls podName:7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b nodeName:}" failed. No retries permitted until 2026-07-21 16:25:46.892679075 +0000 UTC m=+43.233598940 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls") pod "dns-default-xzhjt" (UID: "7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:42.892743 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:42.892731    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:42.892910 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:42.892791    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls podName:1dd0c780-6942-4888-8a62-31c132d0e662 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:46.892773787 +0000 UTC m=+43.233693650 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzzv9" (UID: "1dd0c780-6942-4888-8a62-31c132d0e662") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:43.449464 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:43.449428    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" event={"ID":"ca635a90-6026-4166-9b29-8c4224ad1f16","Type":"ContainerStarted","Data":"317cc76e36870b4a6b05bf045b2dade4b979a38972e08cb46a232d2a06e46ccd"}
Jul 21 16:25:43.476494 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:43.476444    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7jbcn" podStartSLOduration=8.624245047 podStartE2EDuration="39.476428803s" totalImagesPullingTime="30.852183756s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:43.475402184 +0000 UTC m=+39.816322047" watchObservedRunningTime="2026-07-21 16:25:43.476428803 +0000 UTC m=+39.817348666"
Jul 21 16:25:45.454982 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:45.454942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-gdv7q" event={"ID":"29780007-dfc2-4809-abce-660c2cd03c24","Type":"ContainerStarted","Data":"eb73de4885ae0b0c11a249b99d6ec6acd995327f8ddb444d57f56ee4539dbeac"}
Jul 21 16:25:45.456434 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:45.456412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c56mx" event={"ID":"2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60","Type":"ContainerStarted","Data":"3648bddfac08dbdfe21febd1acc26da717d862def355dfd36d91a27772488533"}
Jul 21 16:25:45.470704 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:45.470614    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-gdv7q" podStartSLOduration=3.04994931 podStartE2EDuration="6.470597802s" totalImagesPullingTime="3.420648492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:45.470439863 +0000 UTC m=+41.811359725" watchObservedRunningTime="2026-07-21 16:25:45.470597802 +0000 UTC m=+41.811517666"
Jul 21 16:25:45.486740 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:45.486700    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c56mx" podStartSLOduration=3.068106913 podStartE2EDuration="6.486684442s" totalImagesPullingTime="3.418577529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:45.486212567 +0000 UTC m=+41.827132428" watchObservedRunningTime="2026-07-21 16:25:45.486684442 +0000 UTC m=+41.827604283"
Jul 21 16:25:46.926754 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:46.926712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:46.927189 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:46.926765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:46.927189 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:46.926852    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:46.927189 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:46.926859    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 21 16:25:46.927189 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:46.926905    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls podName:1dd0c780-6942-4888-8a62-31c132d0e662 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:54.926890174 +0000 UTC m=+51.267810014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qzzv9" (UID: "1dd0c780-6942-4888-8a62-31c132d0e662") : secret "insights-runtime-extractor-tls" not found
Jul 21 16:25:46.927189 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:25:46.926917    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls podName:7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b nodeName:}" failed. No retries permitted until 2026-07-21 16:25:54.926911786 +0000 UTC m=+51.267831627 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls") pod "dns-default-xzhjt" (UID: "7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b") : secret "dns-default-metrics-tls" not found
Jul 21 16:25:54.988238 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:54.988191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:54.988708 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:54.988250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:54.991984 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:54.991953    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1dd0c780-6942-4888-8a62-31c132d0e662-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qzzv9\" (UID: \"1dd0c780-6942-4888-8a62-31c132d0e662\") " pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:54.992099 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:54.992017    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b-metrics-tls\") pod \"dns-default-xzhjt\" (UID: \"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b\") " pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:55.007630 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:55.007607    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qzzv9"
Jul 21 16:25:55.023765 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:55.023739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:25:55.176382 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:55.176347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qzzv9"]
Jul 21 16:25:55.192666 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:55.192644    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzhjt"]
Jul 21 16:25:55.195979 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:25:55.195957    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7133b6a4_fa3f_4bc8_86c3_a38d04f8a32b.slice/crio-db4a5e5406180f1fdb77ca589cc94bde17fa25df677182440640d59ceb564f81 WatchSource:0}: Error finding container db4a5e5406180f1fdb77ca589cc94bde17fa25df677182440640d59ceb564f81: Status 404 returned error can't find the container with id db4a5e5406180f1fdb77ca589cc94bde17fa25df677182440640d59ceb564f81
Jul 21 16:25:55.481425 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:55.481384    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzhjt" event={"ID":"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b","Type":"ContainerStarted","Data":"db4a5e5406180f1fdb77ca589cc94bde17fa25df677182440640d59ceb564f81"}
Jul 21 16:25:55.482337 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:25:55.482313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzzv9" event={"ID":"1dd0c780-6942-4888-8a62-31c132d0e662","Type":"ContainerStarted","Data":"92b116a1f0020b100ab74843897afd3f833ac34e39e67d35722b8f759a2fbb5f"}
Jul 21 16:26:00.449645 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.449570    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"]
Jul 21 16:26:00.452383 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.452359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.456586 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.456562    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 21 16:26:00.456686 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.456585    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 21 16:26:00.456686 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.456660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 21 16:26:00.456786 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.456710    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 21 16:26:00.463106 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.463085    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"]
Jul 21 16:26:00.464960 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.464942    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.467260 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.467236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-f24qm\""
Jul 21 16:26:00.467359 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.467320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 21 16:26:00.482834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.482780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"]
Jul 21 16:26:00.500525 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.500501    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"]
Jul 21 16:26:00.501741 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.501713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzzv9" event={"ID":"1dd0c780-6942-4888-8a62-31c132d0e662","Type":"ContainerStarted","Data":"ece0968436768db7b6ce6f8f1abd93fb3ba7df083dfa00f2d152a8443c5f32fe"}
Jul 21 16:26:00.503816 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.503716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzhjt" event={"ID":"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b","Type":"ContainerStarted","Data":"881fbf02848a38cdb423a9909ba86a4cfdab7c2b18ec8c4ee2bbca83e8a648cc"}
Jul 21 16:26:00.503816 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.503761    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzhjt" event={"ID":"7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b","Type":"ContainerStarted","Data":"4fc356af206da3146cc2e497c718ce3d974e3230f40e6b5d3e64f4a00b11e51d"}
Jul 21 16:26:00.503966 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.503884    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:26:00.536197 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.536168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdkwp\" (UniqueName: \"kubernetes.io/projected/a2d34bac-40f5-48a5-9607-f65f8264670f-kube-api-access-qdkwp\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.536291 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.536199    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdbpj\" (UniqueName: \"kubernetes.io/projected/32a3a235-dcf9-42a6-b855-6cd06904a7da-kube-api-access-rdbpj\") pod \"managed-serviceaccount-addon-agent-584547fd56-27qb7\" (UID: \"32a3a235-dcf9-42a6-b855-6cd06904a7da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.536455 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.536434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32a3a235-dcf9-42a6-b855-6cd06904a7da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-584547fd56-27qb7\" (UID: \"32a3a235-dcf9-42a6-b855-6cd06904a7da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.536533 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.536497    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2d34bac-40f5-48a5-9607-f65f8264670f-tmp\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.536533 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.536526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a2d34bac-40f5-48a5-9607-f65f8264670f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.569989 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.569904    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xzhjt" podStartSLOduration=16.481088196 podStartE2EDuration="21.569890379s" totalImagesPullingTime="5.088802183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:00.569148362 +0000 UTC m=+56.910068219" watchObservedRunningTime="2026-07-21 16:26:00.569890379 +0000 UTC m=+56.910810251"
Jul 21 16:26:00.636836 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.636801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdkwp\" (UniqueName: \"kubernetes.io/projected/a2d34bac-40f5-48a5-9607-f65f8264670f-kube-api-access-qdkwp\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.636836 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.636835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdbpj\" (UniqueName: \"kubernetes.io/projected/32a3a235-dcf9-42a6-b855-6cd06904a7da-kube-api-access-rdbpj\") pod \"managed-serviceaccount-addon-agent-584547fd56-27qb7\" (UID: \"32a3a235-dcf9-42a6-b855-6cd06904a7da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.637036 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.636916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32a3a235-dcf9-42a6-b855-6cd06904a7da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-584547fd56-27qb7\" (UID: \"32a3a235-dcf9-42a6-b855-6cd06904a7da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.637036 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.636961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2d34bac-40f5-48a5-9607-f65f8264670f-tmp\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.637036 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.636985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a2d34bac-40f5-48a5-9607-f65f8264670f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.637394 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.637366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a2d34bac-40f5-48a5-9607-f65f8264670f-tmp\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.639458 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.639435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/a2d34bac-40f5-48a5-9607-f65f8264670f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.639546 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.639462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32a3a235-dcf9-42a6-b855-6cd06904a7da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-584547fd56-27qb7\" (UID: \"32a3a235-dcf9-42a6-b855-6cd06904a7da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.669516 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.669487    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdkwp\" (UniqueName: \"kubernetes.io/projected/a2d34bac-40f5-48a5-9607-f65f8264670f-kube-api-access-qdkwp\") pod \"klusterlet-addon-workmgr-7f95c94965-9dwtw\" (UID: \"a2d34bac-40f5-48a5-9607-f65f8264670f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.670447 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.670423    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bbfff877f-pljhn"]
Jul 21 16:26:00.671670 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.671646    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdbpj\" (UniqueName: \"kubernetes.io/projected/32a3a235-dcf9-42a6-b855-6cd06904a7da-kube-api-access-rdbpj\") pod \"managed-serviceaccount-addon-agent-584547fd56-27qb7\" (UID: \"32a3a235-dcf9-42a6-b855-6cd06904a7da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.672889 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.672862    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.675042 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.675021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 16:26:00.675173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.675083    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 16:26:00.675285 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.675272    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 16:26:00.676068 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.676047    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-74hb8\""
Jul 21 16:26:00.685158 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.685140    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 16:26:00.695394 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.695365    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbfff877f-pljhn"]
Jul 21 16:26:00.737939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.737918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/60392c6d-e5aa-4586-a53e-fc72e045b701-registry-certificates\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738034 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.737944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tncf\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-kube-api-access-6tncf\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738034 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.737977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/60392c6d-e5aa-4586-a53e-fc72e045b701-installation-pull-secrets\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738034 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.738026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/60392c6d-e5aa-4586-a53e-fc72e045b701-image-registry-private-configuration\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738157 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.738071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/60392c6d-e5aa-4586-a53e-fc72e045b701-ca-trust-extracted\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738157 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.738094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-bound-sa-token\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738157 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.738137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-registry-tls\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.738255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.738157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60392c6d-e5aa-4586-a53e-fc72e045b701-trusted-ca\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.783495 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.783471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:00.794279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.794258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"
Jul 21 16:26:00.839311 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-registry-tls\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839502 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60392c6d-e5aa-4586-a53e-fc72e045b701-trusted-ca\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839502 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/60392c6d-e5aa-4586-a53e-fc72e045b701-registry-certificates\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839502 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tncf\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-kube-api-access-6tncf\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839661 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/60392c6d-e5aa-4586-a53e-fc72e045b701-installation-pull-secrets\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839661 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/60392c6d-e5aa-4586-a53e-fc72e045b701-image-registry-private-configuration\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839766 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839662    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/60392c6d-e5aa-4586-a53e-fc72e045b701-ca-trust-extracted\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.839766 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.839691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-bound-sa-token\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.841626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.841565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/60392c6d-e5aa-4586-a53e-fc72e045b701-trusted-ca\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.841626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.841583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/60392c6d-e5aa-4586-a53e-fc72e045b701-registry-certificates\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.842141 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.842074    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/60392c6d-e5aa-4586-a53e-fc72e045b701-ca-trust-extracted\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.848828 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.848252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tncf\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-kube-api-access-6tncf\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.848828 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.848339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/60392c6d-e5aa-4586-a53e-fc72e045b701-installation-pull-secrets\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.848828 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.848777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-registry-tls\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.849430 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.849387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/60392c6d-e5aa-4586-a53e-fc72e045b701-image-registry-private-configuration\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.850142 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.850082    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/60392c6d-e5aa-4586-a53e-fc72e045b701-bound-sa-token\") pod \"image-registry-6bbfff877f-pljhn\" (UID: \"60392c6d-e5aa-4586-a53e-fc72e045b701\") " pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:00.929398 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.929360    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"]
Jul 21 16:26:00.955687 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.955631    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7"]
Jul 21 16:26:00.958774 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:00.958742    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32a3a235_dcf9_42a6_b855_6cd06904a7da.slice/crio-0b240295bf6516dbfc152ee96b4344a979037193b20e4f7b69b1355a0c9b5872 WatchSource:0}: Error finding container 0b240295bf6516dbfc152ee96b4344a979037193b20e4f7b69b1355a0c9b5872: Status 404 returned error can't find the container with id 0b240295bf6516dbfc152ee96b4344a979037193b20e4f7b69b1355a0c9b5872
Jul 21 16:26:00.982329 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:00.982299    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:01.142438 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.142392    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbfff877f-pljhn"]
Jul 21 16:26:01.145965 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:01.145934    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60392c6d_e5aa_4586_a53e_fc72e045b701.slice/crio-32f18634df6e628a7f37be785cf00e2f3a24a88da661d73d22c3c4c921d2f719 WatchSource:0}: Error finding container 32f18634df6e628a7f37be785cf00e2f3a24a88da661d73d22c3c4c921d2f719: Status 404 returned error can't find the container with id 32f18634df6e628a7f37be785cf00e2f3a24a88da661d73d22c3c4c921d2f719
Jul 21 16:26:01.509113 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.509015    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn" event={"ID":"60392c6d-e5aa-4586-a53e-fc72e045b701","Type":"ContainerStarted","Data":"85da66a5db88c1508f35f44339bd5ac8cdb14aa52a93247679164ed393aa071e"}
Jul 21 16:26:01.509113 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.509081    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn" event={"ID":"60392c6d-e5aa-4586-a53e-fc72e045b701","Type":"ContainerStarted","Data":"32f18634df6e628a7f37be785cf00e2f3a24a88da661d73d22c3c4c921d2f719"}
Jul 21 16:26:01.509113 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.509106    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:01.510476 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.510445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7" event={"ID":"32a3a235-dcf9-42a6-b855-6cd06904a7da","Type":"ContainerStarted","Data":"0b240295bf6516dbfc152ee96b4344a979037193b20e4f7b69b1355a0c9b5872"}
Jul 21 16:26:01.511905 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.511837    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw" event={"ID":"a2d34bac-40f5-48a5-9607-f65f8264670f","Type":"ContainerStarted","Data":"c5cfc9174bd46dd4382b785fee758318b86ee29ce95eda75982a7b5814d29ed0"}
Jul 21 16:26:01.530102 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:01.530052    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn" podStartSLOduration=1.530034386 podStartE2EDuration="1.530034386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:01.529555435 +0000 UTC m=+57.870475299" watchObservedRunningTime="2026-07-21 16:26:01.530034386 +0000 UTC m=+57.870954250"
Jul 21 16:26:04.423141 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.423100    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wr2q7"
Jul 21 16:26:04.627965 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.627932    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5795bb498c-rm8hv"]
Jul 21 16:26:04.693215 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.693146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5795bb498c-rm8hv"]
Jul 21 16:26:04.693362 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.693265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.695498 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.695473    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 16:26:04.695644 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.695474    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 16:26:04.695813 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.695795    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mztl5\""
Jul 21 16:26:04.695962 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.695943    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 16:26:04.696588 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.696228    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 16:26:04.696588 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.696303    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 16:26:04.696588 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.696342    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 16:26:04.696588 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.696389    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 16:26:04.774487 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.774453    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-service-ca\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.774662 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.774577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-serving-cert\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.774662 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.774642    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-oauth-config\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.774775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.774671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbx9\" (UniqueName: \"kubernetes.io/projected/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-kube-api-access-xsbx9\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.774775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.774716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-oauth-serving-cert\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.774775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.774747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-config\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.875521 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.875476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-oauth-config\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.875709 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.875534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbx9\" (UniqueName: \"kubernetes.io/projected/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-kube-api-access-xsbx9\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.875709 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.875615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-oauth-serving-cert\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.875709 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.875660    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-config\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.875709 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.875683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-service-ca\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.875918 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.875768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-serving-cert\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.876417 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.876367    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-config\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.876539 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.876461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-service-ca\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.876539 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.876481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-oauth-serving-cert\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.878254 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.878229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-oauth-config\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.878368 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.878320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-serving-cert\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:04.883492 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:04.883473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbx9\" (UniqueName: \"kubernetes.io/projected/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-kube-api-access-xsbx9\") pod \"console-5795bb498c-rm8hv\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") " pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:05.004171 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:05.004080    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:06.771601 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:06.771542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5795bb498c-rm8hv"]
Jul 21 16:26:06.775358 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:06.775325    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db0bc83_cdcf_44d2_a4ca_22b5930b0f48.slice/crio-480fc23f26643e49f5a6c0bf0c3e03eb5f962241f002585160783478af8e4eb5 WatchSource:0}: Error finding container 480fc23f26643e49f5a6c0bf0c3e03eb5f962241f002585160783478af8e4eb5: Status 404 returned error can't find the container with id 480fc23f26643e49f5a6c0bf0c3e03eb5f962241f002585160783478af8e4eb5
Jul 21 16:26:07.538174 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.538132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw" event={"ID":"a2d34bac-40f5-48a5-9607-f65f8264670f","Type":"ContainerStarted","Data":"fbd8b50b6f39d5f91ec0cd892d17e8106f80f8fa0b70dda538e06e9e9c8d3944"}
Jul 21 16:26:07.538377 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.538355    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:07.540033 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.540007    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw"
Jul 21 16:26:07.540725 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.540348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7" event={"ID":"32a3a235-dcf9-42a6-b855-6cd06904a7da","Type":"ContainerStarted","Data":"3a6b98c8fdefbd3548423a3776df9e40aa3eadc3e959259fb35b04f3a42ab82c"}
Jul 21 16:26:07.541637 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.541615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795bb498c-rm8hv" event={"ID":"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48","Type":"ContainerStarted","Data":"480fc23f26643e49f5a6c0bf0c3e03eb5f962241f002585160783478af8e4eb5"}
Jul 21 16:26:07.543487 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.543467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzzv9" event={"ID":"1dd0c780-6942-4888-8a62-31c132d0e662","Type":"ContainerStarted","Data":"43ae2ce3c6373a836d9c6660511e50d0b305b6085c7b532010c4cb0f9dffec5f"}
Jul 21 16:26:07.560657 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.560510    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f95c94965-9dwtw" podStartSLOduration=1.8532172180000002 podStartE2EDuration="7.560494351s" totalImagesPullingTime="5.707277133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:07.560399424 +0000 UTC m=+63.901319287" watchObservedRunningTime="2026-07-21 16:26:07.560494351 +0000 UTC m=+63.901414217"
Jul 21 16:26:07.596580 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:07.596432    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-584547fd56-27qb7" podStartSLOduration=1.926797756 podStartE2EDuration="7.5964136s" totalImagesPullingTime="5.669615844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:07.595432312 +0000 UTC m=+63.936352179" watchObservedRunningTime="2026-07-21 16:26:07.5964136 +0000 UTC m=+63.937333464"
Jul 21 16:26:08.911856 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:08.911819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:26:08.912320 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:08.911902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:26:08.914079 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:08.914055    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 16:26:08.914322 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:08.914306    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 16:26:08.925406 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:08.925361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/244a9624-c0ce-4e4e-b22b-91d489bb2a9a-metrics-certs\") pod \"network-metrics-daemon-vlk5d\" (UID: \"244a9624-c0ce-4e4e-b22b-91d489bb2a9a\") " pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:26:08.925510 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:08.925437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/42c8fef1-c834-469a-8e1a-4dfde18f51c1-original-pull-secret\") pod \"global-pull-secret-syncer-zj2d5\" (UID: \"42c8fef1-c834-469a-8e1a-4dfde18f51c1\") " pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:26:09.012310 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.012276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:26:09.014488 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.014461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 16:26:09.025100 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.025078    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 16:26:09.036619 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.036587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v794\" (UniqueName: \"kubernetes.io/projected/9033619e-eb09-4b78-9a93-3967b54301d5-kube-api-access-7v794\") pod \"network-check-target-5g67g\" (UID: \"9033619e-eb09-4b78-9a93-3967b54301d5\") " pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:26:09.197961 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.197872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-crp4d\""
Jul 21 16:26:09.204346 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.204319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrbdq\""
Jul 21 16:26:09.205867 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.205840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:26:09.209154 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.209127    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zj2d5"
Jul 21 16:26:09.213209 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:09.213188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vlk5d"
Jul 21 16:26:10.514200 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:10.514162    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xzhjt"
Jul 21 16:26:11.453429 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.453393    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zj2d5"]
Jul 21 16:26:11.471169 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.471090    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5g67g"]
Jul 21 16:26:11.474501 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:11.474473    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9033619e_eb09_4b78_9a93_3967b54301d5.slice/crio-4e556d27e2c08db13ce696f594a1e4cd376398bdaef2e9ce8ccacb4fd442d6f1 WatchSource:0}: Error finding container 4e556d27e2c08db13ce696f594a1e4cd376398bdaef2e9ce8ccacb4fd442d6f1: Status 404 returned error can't find the container with id 4e556d27e2c08db13ce696f594a1e4cd376398bdaef2e9ce8ccacb4fd442d6f1
Jul 21 16:26:11.487264 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.487235    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vlk5d"]
Jul 21 16:26:11.490523 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:11.490499    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod244a9624_c0ce_4e4e_b22b_91d489bb2a9a.slice/crio-cf9963998d13732d58549c8da4394109e938d948d40e0a41444007778b4691f0 WatchSource:0}: Error finding container cf9963998d13732d58549c8da4394109e938d948d40e0a41444007778b4691f0: Status 404 returned error can't find the container with id cf9963998d13732d58549c8da4394109e938d948d40e0a41444007778b4691f0
Jul 21 16:26:11.560408 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.560335    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qzzv9" event={"ID":"1dd0c780-6942-4888-8a62-31c132d0e662","Type":"ContainerStarted","Data":"e7f3f50a7f10fc3b49419004b9e64ecad3fc6da54434cbf572881c224d58e162"}
Jul 21 16:26:11.561595 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.561571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5g67g" event={"ID":"9033619e-eb09-4b78-9a93-3967b54301d5","Type":"ContainerStarted","Data":"4e556d27e2c08db13ce696f594a1e4cd376398bdaef2e9ce8ccacb4fd442d6f1"}
Jul 21 16:26:11.562693 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.562669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zj2d5" event={"ID":"42c8fef1-c834-469a-8e1a-4dfde18f51c1","Type":"ContainerStarted","Data":"ebcb1b540a9ee2479bd43a834aec3ee3dde9e6d001dc0be9880320d506bce120"}
Jul 21 16:26:11.563902 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.563877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlk5d" event={"ID":"244a9624-c0ce-4e4e-b22b-91d489bb2a9a","Type":"ContainerStarted","Data":"cf9963998d13732d58549c8da4394109e938d948d40e0a41444007778b4691f0"}
Jul 21 16:26:11.565330 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.565309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795bb498c-rm8hv" event={"ID":"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48","Type":"ContainerStarted","Data":"a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5"}
Jul 21 16:26:11.577671 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.577629    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qzzv9" podStartSLOduration=16.628689666 podStartE2EDuration="32.577615709s" totalImagesPullingTime="15.948926043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:11.576853353 +0000 UTC m=+67.917773218" watchObservedRunningTime="2026-07-21 16:26:11.577615709 +0000 UTC m=+67.918535571"
Jul 21 16:26:11.593715 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.593672    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5795bb498c-rm8hv" podStartSLOduration=3.068241066 podStartE2EDuration="7.593659342s" totalImagesPullingTime="4.525418276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:11.59357931 +0000 UTC m=+67.934499174" watchObservedRunningTime="2026-07-21 16:26:11.593659342 +0000 UTC m=+67.934579204"
Jul 21 16:26:11.617737 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.617715    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d657c8f66-642zq"]
Jul 21 16:26:11.622572 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.622558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.629066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.629050    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 16:26:11.631298 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.631280    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d657c8f66-642zq"]
Jul 21 16:26:11.735610 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-service-ca\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.735802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735612    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-console-config\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.735802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735657    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-trusted-ca-bundle\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.735802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-serving-cert\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.735802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-oauth-serving-cert\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.735802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfs4k\" (UniqueName: \"kubernetes.io/projected/f174afdc-2505-4b5a-8162-72030e534368-kube-api-access-zfs4k\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.736003 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.735841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-oauth-config\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-oauth-config\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-service-ca\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-console-config\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836883 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836637    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-trusted-ca-bundle\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836883 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-serving-cert\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836883 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-oauth-serving-cert\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.836883 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.836706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfs4k\" (UniqueName: \"kubernetes.io/projected/f174afdc-2505-4b5a-8162-72030e534368-kube-api-access-zfs4k\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.837452 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.837421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-service-ca\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.837565 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.837461    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-console-config\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.837565 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.837489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-oauth-serving-cert\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.837690 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.837577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-trusted-ca-bundle\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.839065 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.839041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-serving-cert\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.839160 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.839095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-oauth-config\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.844112 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.844096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfs4k\" (UniqueName: \"kubernetes.io/projected/f174afdc-2505-4b5a-8162-72030e534368-kube-api-access-zfs4k\") pod \"console-d657c8f66-642zq\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") " pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:11.931304 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:11.931265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:12.100624 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:12.100020    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d657c8f66-642zq"]
Jul 21 16:26:12.105181 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:12.105150    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf174afdc_2505_4b5a_8162_72030e534368.slice/crio-106b198a103ecee947a7c54b3abba1c7860c932adc0a18afa51dfb471dfc17f6 WatchSource:0}: Error finding container 106b198a103ecee947a7c54b3abba1c7860c932adc0a18afa51dfb471dfc17f6: Status 404 returned error can't find the container with id 106b198a103ecee947a7c54b3abba1c7860c932adc0a18afa51dfb471dfc17f6
Jul 21 16:26:12.573278 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:12.573144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d657c8f66-642zq" event={"ID":"f174afdc-2505-4b5a-8162-72030e534368","Type":"ContainerStarted","Data":"1a0bc89b9d6dbacda2bff1657cd3659553d611ff095d27e43f9239f9e5d7a8ba"}
Jul 21 16:26:12.573278 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:12.573217    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d657c8f66-642zq" event={"ID":"f174afdc-2505-4b5a-8162-72030e534368","Type":"ContainerStarted","Data":"106b198a103ecee947a7c54b3abba1c7860c932adc0a18afa51dfb471dfc17f6"}
Jul 21 16:26:12.591680 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:12.591584    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d657c8f66-642zq" podStartSLOduration=1.591562111 podStartE2EDuration="1.591562111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:12.590741325 +0000 UTC m=+68.931661181" watchObservedRunningTime="2026-07-21 16:26:12.591562111 +0000 UTC m=+68.932481975"
Jul 21 16:26:13.580352 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:13.580263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlk5d" event={"ID":"244a9624-c0ce-4e4e-b22b-91d489bb2a9a","Type":"ContainerStarted","Data":"f96be976d9722d8bc0c745c98b68e8c319b42e3306d90606db24704b8ab06930"}
Jul 21 16:26:13.580352 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:13.580325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vlk5d" event={"ID":"244a9624-c0ce-4e4e-b22b-91d489bb2a9a","Type":"ContainerStarted","Data":"189ab6897b8f50023df1843f2c00817a1b8a8225ce83631745a7b0867b334b63"}
Jul 21 16:26:13.597017 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:13.596966    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vlk5d" podStartSLOduration=68.063583216 podStartE2EDuration="1m9.596950563s" totalImagesPullingTime="1.533367347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:13.596478572 +0000 UTC m=+69.937398439" watchObservedRunningTime="2026-07-21 16:26:13.596950563 +0000 UTC m=+69.937870426"
Jul 21 16:26:15.005241 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:15.005198    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:15.005648 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:15.005276    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:15.010901 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:15.010870    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:15.592935 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:15.592896    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:16.592883 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:16.592847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5g67g" event={"ID":"9033619e-eb09-4b78-9a93-3967b54301d5","Type":"ContainerStarted","Data":"00ab2515932d758106b1d9c12f98f651dddd0136f1b6f46d72a78b4959cc6b1a"}
Jul 21 16:26:16.593293 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:16.592952    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:26:16.594374 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:16.594348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zj2d5" event={"ID":"42c8fef1-c834-469a-8e1a-4dfde18f51c1","Type":"ContainerStarted","Data":"3d640719bfe986927f28ab78a7bbb8ee3d6cfe7b833cda42b5388b7ce0895f2c"}
Jul 21 16:26:16.609419 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:16.609380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5g67g" podStartSLOduration=67.79188801 podStartE2EDuration="1m12.609366264s" totalImagesPullingTime="4.817478254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:16.608713726 +0000 UTC m=+72.949633599" watchObservedRunningTime="2026-07-21 16:26:16.609366264 +0000 UTC m=+72.950286126"
Jul 21 16:26:16.623491 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:16.623448    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zj2d5" podStartSLOduration=67.786613381 podStartE2EDuration="1m12.623435317s" totalImagesPullingTime="4.836821936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:16.622716372 +0000 UTC m=+72.963636239" watchObservedRunningTime="2026-07-21 16:26:16.623435317 +0000 UTC m=+72.964355231"
Jul 21 16:26:18.397546 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.397510    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d7srs"]
Jul 21 16:26:18.401229 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.401202    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.403140 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.403068    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 16:26:18.403592 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.403571    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 16:26:18.403965 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.403767    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 16:26:18.403965 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.403803    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 16:26:18.403965 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.403859    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 16:26:18.404196 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.404106    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 16:26:18.404253 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.403584    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-42mkg\""
Jul 21 16:26:18.492340 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-wtmp\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-sys\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db0c72b-4a7a-49a7-9221-fad874099419-metrics-client-ca\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492488    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-textfile\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-tls\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492817 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-root\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.492817 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.492626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-455vw\" (UniqueName: \"kubernetes.io/projected/7db0c72b-4a7a-49a7-9221-fad874099419-kube-api-access-455vw\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593167 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-sys\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593313 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593215    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-sys\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593313 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593313 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db0c72b-4a7a-49a7-9221-fad874099419-metrics-client-ca\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-textfile\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-tls\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593478 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-root\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593663 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593483    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-455vw\" (UniqueName: \"kubernetes.io/projected/7db0c72b-4a7a-49a7-9221-fad874099419-kube-api-access-455vw\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593663 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-wtmp\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593764 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593733    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-wtmp\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.593907 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.593879    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-accelerators-collector-config\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.594025 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:26:18.593981    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 21 16:26:18.594099 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:26:18.594046    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-tls podName:7db0c72b-4a7a-49a7-9221-fad874099419 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:19.094026728 +0000 UTC m=+75.434946572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-tls") pod "node-exporter-d7srs" (UID: "7db0c72b-4a7a-49a7-9221-fad874099419") : secret "node-exporter-tls" not found
Jul 21 16:26:18.594279 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.594239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7db0c72b-4a7a-49a7-9221-fad874099419-metrics-client-ca\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.594354 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.594297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7db0c72b-4a7a-49a7-9221-fad874099419-root\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.594601 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.594577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-textfile\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.596265 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.596241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:18.604533 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:18.604511    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-455vw\" (UniqueName: \"kubernetes.io/projected/7db0c72b-4a7a-49a7-9221-fad874099419-kube-api-access-455vw\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:19.097682 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.097646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-tls\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:19.099966 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.099947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7db0c72b-4a7a-49a7-9221-fad874099419-node-exporter-tls\") pod \"node-exporter-d7srs\" (UID: \"7db0c72b-4a7a-49a7-9221-fad874099419\") " pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:19.313556 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.313525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d7srs"
Jul 21 16:26:19.325370 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:19.325325    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db0c72b_4a7a_49a7_9221_fad874099419.slice/crio-d32c546c37c11dc2a2277d478343747d0216d01590203e9e060123ac99265a02 WatchSource:0}: Error finding container d32c546c37c11dc2a2277d478343747d0216d01590203e9e060123ac99265a02: Status 404 returned error can't find the container with id d32c546c37c11dc2a2277d478343747d0216d01590203e9e060123ac99265a02
Jul 21 16:26:19.406589 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.406493    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:26:19.411081 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.411062    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.413043 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413017    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 16:26:19.413043 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413037    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 16:26:19.413602 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413577    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 16:26:19.413727 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413614    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 16:26:19.413830 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413815    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 16:26:19.413925 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413824    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 16:26:19.413925 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.413837    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 16:26:19.414300 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.414280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 16:26:19.414405 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.414301    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4vpxh\""
Jul 21 16:26:19.414405 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.414280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 16:26:19.425784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.425761    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:26:19.500522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3a5365f-4821-4d92-ba01-5b814791a6bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500522 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-web-config\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500583    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3a5365f-4821-4d92-ba01-5b814791a6bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3a5365f-4821-4d92-ba01-5b814791a6bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500715    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8nk\" (UniqueName: \"kubernetes.io/projected/e3a5365f-4821-4d92-ba01-5b814791a6bc-kube-api-access-zj8nk\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500744 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500973 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500973 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500777    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500973 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3a5365f-4821-4d92-ba01-5b814791a6bc-config-out\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.500973 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.500879    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a5365f-4821-4d92-ba01-5b814791a6bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.601834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.601796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3a5365f-4821-4d92-ba01-5b814791a6bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.601834 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.601837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3a5365f-4821-4d92-ba01-5b814791a6bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.601858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8nk\" (UniqueName: \"kubernetes.io/projected/e3a5365f-4821-4d92-ba01-5b814791a6bc-kube-api-access-zj8nk\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.601975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602026 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602193 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602193 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3a5365f-4821-4d92-ba01-5b814791a6bc-config-out\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602298 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e3a5365f-4821-4d92-ba01-5b814791a6bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602298 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a5365f-4821-4d92-ba01-5b814791a6bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602348    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3a5365f-4821-4d92-ba01-5b814791a6bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602502 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602502 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-web-config\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602502 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.602666 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.602631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3a5365f-4821-4d92-ba01-5b814791a6bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.603088 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.603051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e3a5365f-4821-4d92-ba01-5b814791a6bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.605437 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.605315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e3a5365f-4821-4d92-ba01-5b814791a6bc-config-out\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.605543 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.605467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.605756 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.605726    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.605886 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.605863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.605942 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.605904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e3a5365f-4821-4d92-ba01-5b814791a6bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.606688 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.606657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.606823 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.606711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-web-config\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.606823 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.606805    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.607384 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.607362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3a5365f-4821-4d92-ba01-5b814791a6bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.608875 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.608849    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7srs" event={"ID":"7db0c72b-4a7a-49a7-9221-fad874099419","Type":"ContainerStarted","Data":"d32c546c37c11dc2a2277d478343747d0216d01590203e9e060123ac99265a02"}
Jul 21 16:26:19.611702 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.611685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8nk\" (UniqueName: \"kubernetes.io/projected/e3a5365f-4821-4d92-ba01-5b814791a6bc-kube-api-access-zj8nk\") pod \"alertmanager-main-0\" (UID: \"e3a5365f-4821-4d92-ba01-5b814791a6bc\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.720550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.720463    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 16:26:19.883281 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:19.883251    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 16:26:19.888027 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:19.887998    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3a5365f_4821_4d92_ba01_5b814791a6bc.slice/crio-2eec4041fb4e887f7247283522488cdbdb0baf15a408d1b9ae602eddd33a5115 WatchSource:0}: Error finding container 2eec4041fb4e887f7247283522488cdbdb0baf15a408d1b9ae602eddd33a5115: Status 404 returned error can't find the container with id 2eec4041fb4e887f7247283522488cdbdb0baf15a408d1b9ae602eddd33a5115
Jul 21 16:26:20.613258 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:20.613219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"2eec4041fb4e887f7247283522488cdbdb0baf15a408d1b9ae602eddd33a5115"}
Jul 21 16:26:20.614831 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:20.614799    2577 generic.go:356] "Generic (PLEG): container finished" podID="7db0c72b-4a7a-49a7-9221-fad874099419" containerID="e9b3a339f932d174159d647147839caeb99a3fe0d6251bd3574ce2e371a3e8ae" exitCode=0
Jul 21 16:26:20.614961 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:20.614878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7srs" event={"ID":"7db0c72b-4a7a-49a7-9221-fad874099419","Type":"ContainerDied","Data":"e9b3a339f932d174159d647147839caeb99a3fe0d6251bd3574ce2e371a3e8ae"}
Jul 21 16:26:21.620054 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.620021    2577 generic.go:356] "Generic (PLEG): container finished" podID="e3a5365f-4821-4d92-ba01-5b814791a6bc" containerID="bd836e454709e74fd413917b3fc2c7398386baafcc1210fd528c687e3c34ffb8" exitCode=0
Jul 21 16:26:21.620482 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.620107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerDied","Data":"bd836e454709e74fd413917b3fc2c7398386baafcc1210fd528c687e3c34ffb8"}
Jul 21 16:26:21.622418 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.622390    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7srs" event={"ID":"7db0c72b-4a7a-49a7-9221-fad874099419","Type":"ContainerStarted","Data":"6b545f971c054795d8ffb1c983257395b50539f21144706c15d89af7859e4e4d"}
Jul 21 16:26:21.622515 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.622431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d7srs" event={"ID":"7db0c72b-4a7a-49a7-9221-fad874099419","Type":"ContainerStarted","Data":"ed2365c9acdd750f664086751d2d44f094bb1b3270fdb35b5dc5a73cef726ff1"}
Jul 21 16:26:21.688956 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.688902    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d7srs" podStartSLOduration=2.6321758219999998 podStartE2EDuration="3.688883722s" totalImagesPullingTime="989.585853ms" totalInitContainerRuntime="67.122047ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:21.68754374 +0000 UTC m=+78.028463602" watchObservedRunningTime="2026-07-21 16:26:21.688883722 +0000 UTC m=+78.029803587"
Jul 21 16:26:21.931540 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.931457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:21.931540 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.931507    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:21.936182 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:21.936159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:22.522573 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.522543    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bbfff877f-pljhn"
Jul 21 16:26:22.630213 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.630181    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:26:22.652332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.652302    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6668948645-fslhr"]
Jul 21 16:26:22.655692 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.655668    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.657747 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.657725    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 16:26:22.657927 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.657905    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 16:26:22.658024 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.657980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5dutomk4fp49i\""
Jul 21 16:26:22.658089 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.658034    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 16:26:22.658283 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.658266    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 16:26:22.658379 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.658282    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-5c6dz\""
Jul 21 16:26:22.664959 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.664906    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6668948645-fslhr"]
Jul 21 16:26:22.686516 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.686488    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5795bb498c-rm8hv"]
Jul 21 16:26:22.728332 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.728304    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f88d3d-1e7b-438e-9558-6cf73f36722c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.728498 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.728357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f88d3d-1e7b-438e-9558-6cf73f36722c-metrics-server-audit-profiles\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.728498 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.728402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-secret-metrics-server-tls\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.728498 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.728466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-client-ca-bundle\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.729017 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.728982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-secret-metrics-server-client-certs\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.729173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.729022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f88d3d-1e7b-438e-9558-6cf73f36722c-audit-log\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.729173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.729086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gfx\" (UniqueName: \"kubernetes.io/projected/63f88d3d-1e7b-438e-9558-6cf73f36722c-kube-api-access-l4gfx\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830583 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f88d3d-1e7b-438e-9558-6cf73f36722c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830583 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f88d3d-1e7b-438e-9558-6cf73f36722c-metrics-server-audit-profiles\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830793 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-secret-metrics-server-tls\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830829 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-client-ca-bundle\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830862 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-secret-metrics-server-client-certs\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830909 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f88d3d-1e7b-438e-9558-6cf73f36722c-audit-log\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.830909 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.830904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gfx\" (UniqueName: \"kubernetes.io/projected/63f88d3d-1e7b-438e-9558-6cf73f36722c-kube-api-access-l4gfx\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.831417 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.831361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63f88d3d-1e7b-438e-9558-6cf73f36722c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.831615 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.831569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/63f88d3d-1e7b-438e-9558-6cf73f36722c-audit-log\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.831739 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.831636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/63f88d3d-1e7b-438e-9558-6cf73f36722c-metrics-server-audit-profiles\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.833608 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.833579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-secret-metrics-server-tls\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.833711 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.833618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-client-ca-bundle\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.833926 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.833904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/63f88d3d-1e7b-438e-9558-6cf73f36722c-secret-metrics-server-client-certs\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.838364 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.838345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gfx\" (UniqueName: \"kubernetes.io/projected/63f88d3d-1e7b-438e-9558-6cf73f36722c-kube-api-access-l4gfx\") pod \"metrics-server-6668948645-fslhr\" (UID: \"63f88d3d-1e7b-438e-9558-6cf73f36722c\") " pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:22.968392 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:22.968356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:23.305749 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.305717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6668948645-fslhr"]
Jul 21 16:26:23.632660 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.632620    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"21dec5ed58ffab2ab401237bb8fa63e53bb0da7c348906279be6bfd47ef7a79a"}
Jul 21 16:26:23.633067 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.632727    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"0e55df5543e5c1b016e121df134e77d74b66644b8849675ee77599fe57194970"}
Jul 21 16:26:23.633067 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.632756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"f85254a80ee85569a55bc9207a75128dda11b6d4ddadaaebe97ce1df33c102e4"}
Jul 21 16:26:23.633067 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.632788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"cdde768759700622c06be8031fd11b069183e455052b4d5fd1e464939decae4a"}
Jul 21 16:26:23.633067 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.632813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"aaf4693440fee0ea976c2dff6f3e84a4bd4822b39cdb7dad1d92891b9aadb39e"}
Jul 21 16:26:23.633753 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:23.633721    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6668948645-fslhr" event={"ID":"63f88d3d-1e7b-438e-9558-6cf73f36722c","Type":"ContainerStarted","Data":"747002d44e5a7a932b68c934dea903e82c6fa16ced027b8814f6e352e84a21d5"}
Jul 21 16:26:24.155023 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.154975    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5669996cdd-l9ghr"]
Jul 21 16:26:24.158620 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.158596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.177151 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.177106    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669996cdd-l9ghr"]
Jul 21 16:26:24.243481 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-oauth-serving-cert\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.243639 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-config\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.243639 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-service-ca\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.243639 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-trusted-ca-bundle\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.243805 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/92595b56-9b65-4dd2-89ab-f1c28b778c2b-kube-api-access-4np4s\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.243805 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-oauth-config\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.243805 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.243799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-serving-cert\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.344867 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.344830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-oauth-serving-cert\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345035 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.344875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-config\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345035 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.344917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-service-ca\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345035 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.344939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-trusted-ca-bundle\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345035 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.344974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/92595b56-9b65-4dd2-89ab-f1c28b778c2b-kube-api-access-4np4s\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345035 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.345008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-oauth-config\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345322 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.345048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-serving-cert\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345779 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.345704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-oauth-serving-cert\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345779 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.345704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-config\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.345963 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.345933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-service-ca\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.346087 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.346066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-trusted-ca-bundle\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.347730 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.347707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-serving-cert\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.347951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.347928    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-oauth-config\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.356156 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.356132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/92595b56-9b65-4dd2-89ab-f1c28b778c2b-kube-api-access-4np4s\") pod \"console-5669996cdd-l9ghr\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") " pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.469526 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.469440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:24.656939 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.656906    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 16:26:24.660685 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.660663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.663046 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.662863    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 21 16:26:24.663046 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.662903    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 21 16:26:24.663046 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.662939    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 21 16:26:24.663046 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.662952    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 21 16:26:24.663046 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663031    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 21 16:26:24.663719 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663274    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 21 16:26:24.663719 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663287    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 21 16:26:24.663719 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663634    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-59nq2\""
Jul 21 16:26:24.663719 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663674    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 21 16:26:24.663719 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663707    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 21 16:26:24.664149 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663898    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 21 16:26:24.664149 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.663938    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 21 16:26:24.664149 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.664023    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 21 16:26:24.666852 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.666186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4r5n6d81s76qi\""
Jul 21 16:26:24.666852 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.666595    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 21 16:26:24.670198 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.670176    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 21 16:26:24.680187 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.680164    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 16:26:24.749252 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7910a975-fc1f-4a24-9044-f6cb6048e461-config-out\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749252 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749218    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749252 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749325    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-web-config\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749344    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7910a975-fc1f-4a24-9044-f6cb6048e461-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749557    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-config\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749734    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf7l2\" (UniqueName: \"kubernetes.io/projected/7910a975-fc1f-4a24-9044-f6cb6048e461-kube-api-access-qf7l2\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749750    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.749784 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.749773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850533 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850643 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850643 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7910a975-fc1f-4a24-9044-f6cb6048e461-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850643 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850803 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850649    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850803 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850803 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850803 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.850803 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850755    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-config\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf7l2\" (UniqueName: \"kubernetes.io/projected/7910a975-fc1f-4a24-9044-f6cb6048e461-kube-api-access-qf7l2\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.850926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7910a975-fc1f-4a24-9044-f6cb6048e461-config-out\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851301 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851301 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851301 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851301 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-web-config\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851301 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.851660 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.851611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.853868 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.852521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.853868 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.852653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.853868 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.853739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.857424 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.856313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.857424 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.856582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.857424 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.857044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.857424 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.857247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.860941 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.860718    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7910a975-fc1f-4a24-9044-f6cb6048e461-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.861037 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.860956    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-config\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.861626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.861259    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.861626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.861316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.861626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.861370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7910a975-fc1f-4a24-9044-f6cb6048e461-config-out\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.861626 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.861563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.861887 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.861688    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.862008 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.861966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.862440 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.862318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-web-config\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.862440 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.862401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7910a975-fc1f-4a24-9044-f6cb6048e461-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.862639 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.862615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7910a975-fc1f-4a24-9044-f6cb6048e461-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.864490 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.864467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf7l2\" (UniqueName: \"kubernetes.io/projected/7910a975-fc1f-4a24-9044-f6cb6048e461-kube-api-access-qf7l2\") pod \"prometheus-k8s-0\" (UID: \"7910a975-fc1f-4a24-9044-f6cb6048e461\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:24.933483 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.933447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5669996cdd-l9ghr"]
Jul 21 16:26:24.937229 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:24.937200    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92595b56_9b65_4dd2_89ab_f1c28b778c2b.slice/crio-9a841c7ac7727fa1c31d2d19ea1e79ec03c90a5971850832db9f0b30d9c9a6dd WatchSource:0}: Error finding container 9a841c7ac7727fa1c31d2d19ea1e79ec03c90a5971850832db9f0b30d9c9a6dd: Status 404 returned error can't find the container with id 9a841c7ac7727fa1c31d2d19ea1e79ec03c90a5971850832db9f0b30d9c9a6dd
Jul 21 16:26:24.976693 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:24.976672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:25.137607 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.137574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 21 16:26:25.142948 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:26:25.142918    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7910a975_fc1f_4a24_9044_f6cb6048e461.slice/crio-2f6ae5192151fc0197db3cce9420364408576522eec1d94617215ea3f1a9e2ce WatchSource:0}: Error finding container 2f6ae5192151fc0197db3cce9420364408576522eec1d94617215ea3f1a9e2ce: Status 404 returned error can't find the container with id 2f6ae5192151fc0197db3cce9420364408576522eec1d94617215ea3f1a9e2ce
Jul 21 16:26:25.645510 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.645476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e3a5365f-4821-4d92-ba01-5b814791a6bc","Type":"ContainerStarted","Data":"b25ec943d8c8ac0fb1909af9e3ba36f6b435788d5d830e3dad926119d0a1ce1c"}
Jul 21 16:26:25.647079 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.647042    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669996cdd-l9ghr" event={"ID":"92595b56-9b65-4dd2-89ab-f1c28b778c2b","Type":"ContainerStarted","Data":"a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407"}
Jul 21 16:26:25.647239 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.647095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669996cdd-l9ghr" event={"ID":"92595b56-9b65-4dd2-89ab-f1c28b778c2b","Type":"ContainerStarted","Data":"9a841c7ac7727fa1c31d2d19ea1e79ec03c90a5971850832db9f0b30d9c9a6dd"}
Jul 21 16:26:25.648547 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.648525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6668948645-fslhr" event={"ID":"63f88d3d-1e7b-438e-9558-6cf73f36722c","Type":"ContainerStarted","Data":"086a16b285e2bc234db98003c280276890d51d6e61f6817fc44cb8097327d268"}
Jul 21 16:26:25.650021 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.649999    2577 generic.go:356] "Generic (PLEG): container finished" podID="7910a975-fc1f-4a24-9044-f6cb6048e461" containerID="dd292771cf75f326d518cbf43efcafaa795cd4a5168c96f981eb69bf9f39b843" exitCode=0
Jul 21 16:26:25.650099 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.650036    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerDied","Data":"dd292771cf75f326d518cbf43efcafaa795cd4a5168c96f981eb69bf9f39b843"}
Jul 21 16:26:25.650099 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.650090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"2f6ae5192151fc0197db3cce9420364408576522eec1d94617215ea3f1a9e2ce"}
Jul 21 16:26:25.671848 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.671805    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.625732841 podStartE2EDuration="6.671789965s" totalImagesPullingTime="4.02970207s" totalInitContainerRuntime="16.355054ms" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:25.670494713 +0000 UTC m=+82.011414575" watchObservedRunningTime="2026-07-21 16:26:25.671789965 +0000 UTC m=+82.012709827"
Jul 21 16:26:25.690361 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.690248    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6668948645-fslhr" podStartSLOduration=2.196139542 podStartE2EDuration="3.690232495s" totalImagesPullingTime="1.494092953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:25.689293993 +0000 UTC m=+82.030213855" watchObservedRunningTime="2026-07-21 16:26:25.690232495 +0000 UTC m=+82.031152359"
Jul 21 16:26:25.707352 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:25.707314    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5669996cdd-l9ghr" podStartSLOduration=1.7073008280000002 podStartE2EDuration="1.707300828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:25.705373498 +0000 UTC m=+82.046293357" watchObservedRunningTime="2026-07-21 16:26:25.707300828 +0000 UTC m=+82.048220767"
Jul 21 16:26:28.431130 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:28.431082    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669996cdd-l9ghr"]
Jul 21 16:26:29.671049 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:29.671006    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"c6d8eb141ea294413be57089b2ba05331592e08bf677aadfadfac82ba57dd8bb"}
Jul 21 16:26:29.671493 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:29.671092    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"7057655532c2b2413d67637333074879212c9fb1670102c5f0a5416b324e232b"}
Jul 21 16:26:31.681839 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:31.681799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"847943a80d9137a66c74796905b4f81b7a24f331713ea96b75fc4a810e1a6b7b"}
Jul 21 16:26:31.682203 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:31.681861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"361622b4f695d000b5e3d495b53931cf934c22abf712f8f42bd03c5f98c0f773"}
Jul 21 16:26:31.682203 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:31.681885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"7a17d0d88ac1c4a5f6b882b100e10a9cd5b2936a091118e5967ca40f59a4e16f"}
Jul 21 16:26:31.682203 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:31.681909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7910a975-fc1f-4a24-9044-f6cb6048e461","Type":"ContainerStarted","Data":"5ec04613647c12dd06d33812f7b91dce20839d813d18190ff71ca5fc5d76b014"}
Jul 21 16:26:31.712989 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:31.712936    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.746475761 podStartE2EDuration="7.712921833s" totalImagesPullingTime="4.948469967s" totalInitContainerRuntime="17.976105ms" isStatefulPod=false podCreationTimestamp="2026-07-21 16:26:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:26:31.711607184 +0000 UTC m=+88.052527069" watchObservedRunningTime="2026-07-21 16:26:31.712921833 +0000 UTC m=+88.053841696"
Jul 21 16:26:34.470594 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:34.470561    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:34.977260 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:34.977210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:26:39.580161 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:39.580107    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d657c8f66-642zq"]
Jul 21 16:26:42.969396 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:42.969358    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:42.969851 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:42.969425    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:26:47.600844 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:47.600811    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5g67g"
Jul 21 16:26:47.711883 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:47.711822    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5795bb498c-rm8hv" podUID="0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" containerName="console" containerID="cri-o://a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5" gracePeriod=15
Jul 21 16:26:48.475913 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.475890    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:48.560767 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.560728    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-config\") pod \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") "
Jul 21 16:26:48.560923 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.560792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-service-ca\") pod \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") "
Jul 21 16:26:48.560923 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.560810    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-oauth-serving-cert\") pod \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") "
Jul 21 16:26:48.561014 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.560996    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-oauth-config\") pod \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") "
Jul 21 16:26:48.561070 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561053    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-serving-cert\") pod \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") "
Jul 21 16:26:48.561154 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561138    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsbx9\" (UniqueName: \"kubernetes.io/projected/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-kube-api-access-xsbx9\") pod \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\" (UID: \"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48\") "
Jul 21 16:26:48.561262 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561234    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-service-ca" (OuterVolumeSpecName: "service-ca") pod "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" (UID: "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:48.561262 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561250    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" (UID: "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:48.561375 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561238    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-config" (OuterVolumeSpecName: "console-config") pod "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" (UID: "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:48.561434 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561419    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-config\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:48.561494 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561437    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:48.561494 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.561445    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-oauth-serving-cert\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:48.563317 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.563284    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" (UID: "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:26:48.563418 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.563389    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" (UID: "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:26:48.563418 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.563391    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-kube-api-access-xsbx9" (OuterVolumeSpecName: "kube-api-access-xsbx9") pod "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" (UID: "0db0bc83-cdcf-44d2-a4ca-22b5930b0f48"). InnerVolumeSpecName "kube-api-access-xsbx9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:26:48.661847 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.661809    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-serving-cert\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:48.661847 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.661839    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsbx9\" (UniqueName: \"kubernetes.io/projected/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-kube-api-access-xsbx9\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:48.661847 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.661849    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48-console-oauth-config\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:48.752261 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.752181    2577 generic.go:356] "Generic (PLEG): container finished" podID="0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" containerID="a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5" exitCode=0
Jul 21 16:26:48.752261 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.752226    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5795bb498c-rm8hv"
Jul 21 16:26:48.752428 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.752264    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795bb498c-rm8hv" event={"ID":"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48","Type":"ContainerDied","Data":"a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5"}
Jul 21 16:26:48.752428 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.752314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5795bb498c-rm8hv" event={"ID":"0db0bc83-cdcf-44d2-a4ca-22b5930b0f48","Type":"ContainerDied","Data":"480fc23f26643e49f5a6c0bf0c3e03eb5f962241f002585160783478af8e4eb5"}
Jul 21 16:26:48.752428 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.752334    2577 scope.go:117] "RemoveContainer" containerID="a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5"
Jul 21 16:26:48.764976 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.764961    2577 scope.go:117] "RemoveContainer" containerID="a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5"
Jul 21 16:26:48.765240 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:26:48.765222    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5\": container with ID starting with a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5 not found: ID does not exist" containerID="a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5"
Jul 21 16:26:48.765296 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.765247    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5"} err="failed to get container status \"a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5\": rpc error: code = NotFound desc = could not find container \"a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5\": container with ID starting with a9bedae4d1ef5e2b74f37c473b14bacd4a6418c3176d5b0d4bc2157ce46d00e5 not found: ID does not exist"
Jul 21 16:26:48.772925 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.772901    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5795bb498c-rm8hv"]
Jul 21 16:26:48.777525 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:48.777505    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5795bb498c-rm8hv"]
Jul 21 16:26:50.189344 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:50.189316    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" path="/var/lib/kubelet/pods/0db0bc83-cdcf-44d2-a4ca-22b5930b0f48/volumes"
Jul 21 16:26:53.455061 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.454987    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5669996cdd-l9ghr" podUID="92595b56-9b65-4dd2-89ab-f1c28b778c2b" containerName="console" containerID="cri-o://a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407" gracePeriod=15
Jul 21 16:26:53.725031 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.724963    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:53.774023 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.773994    2577 generic.go:356] "Generic (PLEG): container finished" podID="92595b56-9b65-4dd2-89ab-f1c28b778c2b" containerID="a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407" exitCode=0
Jul 21 16:26:53.774023 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.774026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669996cdd-l9ghr" event={"ID":"92595b56-9b65-4dd2-89ab-f1c28b778c2b","Type":"ContainerDied","Data":"a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407"}
Jul 21 16:26:53.774256 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.774037    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5669996cdd-l9ghr"
Jul 21 16:26:53.774256 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.774061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5669996cdd-l9ghr" event={"ID":"92595b56-9b65-4dd2-89ab-f1c28b778c2b","Type":"ContainerDied","Data":"9a841c7ac7727fa1c31d2d19ea1e79ec03c90a5971850832db9f0b30d9c9a6dd"}
Jul 21 16:26:53.774256 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.774080    2577 scope.go:117] "RemoveContainer" containerID="a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407"
Jul 21 16:26:53.783718 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.783702    2577 scope.go:117] "RemoveContainer" containerID="a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407"
Jul 21 16:26:53.783960 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:26:53.783939    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407\": container with ID starting with a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407 not found: ID does not exist" containerID="a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407"
Jul 21 16:26:53.784005 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.783966    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407"} err="failed to get container status \"a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407\": rpc error: code = NotFound desc = could not find container \"a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407\": container with ID starting with a64c592b0468b457089b3462e8b360dec40427281836b00298842c5ea2cb1407 not found: ID does not exist"
Jul 21 16:26:53.806277 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806249    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-service-ca\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806293    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-oauth-serving-cert\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806337    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/92595b56-9b65-4dd2-89ab-f1c28b778c2b-kube-api-access-4np4s\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806391    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-oauth-config\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806549 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806528    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-config\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806600 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806559    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-serving-cert\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806655 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-trusted-ca-bundle\") pod \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\" (UID: \"92595b56-9b65-4dd2-89ab-f1c28b778c2b\") "
Jul 21 16:26:53.806655 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806629    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-service-ca" (OuterVolumeSpecName: "service-ca") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:53.806758 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806714    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:53.806997 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.806945    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-config" (OuterVolumeSpecName: "console-config") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:53.807078 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.807028    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:53.807078 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.807046    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:26:53.807078 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.807048    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-oauth-serving-cert\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:53.807078 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.807072    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-config\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:53.808518 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.808491    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92595b56-9b65-4dd2-89ab-f1c28b778c2b-kube-api-access-4np4s" (OuterVolumeSpecName: "kube-api-access-4np4s") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "kube-api-access-4np4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:26:53.808606 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.808497    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:26:53.808606 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.808553    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "92595b56-9b65-4dd2-89ab-f1c28b778c2b" (UID: "92595b56-9b65-4dd2-89ab-f1c28b778c2b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:26:53.908473 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.908444    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4np4s\" (UniqueName: \"kubernetes.io/projected/92595b56-9b65-4dd2-89ab-f1c28b778c2b-kube-api-access-4np4s\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:53.908473 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.908470    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-oauth-config\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:53.908621 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.908480    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/92595b56-9b65-4dd2-89ab-f1c28b778c2b-console-serving-cert\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:53.908621 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:53.908489    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92595b56-9b65-4dd2-89ab-f1c28b778c2b-trusted-ca-bundle\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:26:54.095741 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:54.095710    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5669996cdd-l9ghr"]
Jul 21 16:26:54.101949 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:54.101924    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5669996cdd-l9ghr"]
Jul 21 16:26:54.189657 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:26:54.189618    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92595b56-9b65-4dd2-89ab-f1c28b778c2b" path="/var/lib/kubelet/pods/92595b56-9b65-4dd2-89ab-f1c28b778c2b/volumes"
Jul 21 16:27:02.973909 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:02.973875    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:27:02.977775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:02.977750    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6668948645-fslhr"
Jul 21 16:27:04.600876 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:04.600833    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d657c8f66-642zq" podUID="f174afdc-2505-4b5a-8162-72030e534368" containerName="console" containerID="cri-o://1a0bc89b9d6dbacda2bff1657cd3659553d611ff095d27e43f9239f9e5d7a8ba" gracePeriod=15
Jul 21 16:27:04.816469 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:04.816434    2577 generic.go:356] "Generic (PLEG): container finished" podID="f174afdc-2505-4b5a-8162-72030e534368" containerID="1a0bc89b9d6dbacda2bff1657cd3659553d611ff095d27e43f9239f9e5d7a8ba" exitCode=0
Jul 21 16:27:04.816615 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:04.816507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d657c8f66-642zq" event={"ID":"f174afdc-2505-4b5a-8162-72030e534368","Type":"ContainerDied","Data":"1a0bc89b9d6dbacda2bff1657cd3659553d611ff095d27e43f9239f9e5d7a8ba"}
Jul 21 16:27:04.846765 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:04.846741    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:27:05.009799 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009721    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-trusted-ca-bundle\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.009799 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009751    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-oauth-serving-cert\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.009799 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009787    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-service-ca\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.010030 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009833    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-serving-cert\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.010030 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009854    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfs4k\" (UniqueName: \"kubernetes.io/projected/f174afdc-2505-4b5a-8162-72030e534368-kube-api-access-zfs4k\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.010030 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009878    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-console-config\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.010030 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.009907    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-oauth-config\") pod \"f174afdc-2505-4b5a-8162-72030e534368\" (UID: \"f174afdc-2505-4b5a-8162-72030e534368\") "
Jul 21 16:27:05.010272 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.010239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:27:05.010339 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.010250    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:27:05.010339 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.010312    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-service-ca" (OuterVolumeSpecName: "service-ca") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:27:05.010425 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.010350    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-console-config" (OuterVolumeSpecName: "console-config") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:27:05.012307 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.012280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f174afdc-2505-4b5a-8162-72030e534368-kube-api-access-zfs4k" (OuterVolumeSpecName: "kube-api-access-zfs4k") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "kube-api-access-zfs4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:27:05.012554 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.012530    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:27:05.012662 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.012643    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f174afdc-2505-4b5a-8162-72030e534368" (UID: "f174afdc-2505-4b5a-8162-72030e534368"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:27:05.111351 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111312    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-trusted-ca-bundle\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.111351 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111344    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-oauth-serving-cert\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.111351 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111357    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.111574 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111370    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-serving-cert\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.111574 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111381    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfs4k\" (UniqueName: \"kubernetes.io/projected/f174afdc-2505-4b5a-8162-72030e534368-kube-api-access-zfs4k\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.111574 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111393    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f174afdc-2505-4b5a-8162-72030e534368-console-config\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.111574 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.111403    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f174afdc-2505-4b5a-8162-72030e534368-console-oauth-config\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:27:05.821952 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.821920    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d657c8f66-642zq"
Jul 21 16:27:05.822382 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.821950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d657c8f66-642zq" event={"ID":"f174afdc-2505-4b5a-8162-72030e534368","Type":"ContainerDied","Data":"106b198a103ecee947a7c54b3abba1c7860c932adc0a18afa51dfb471dfc17f6"}
Jul 21 16:27:05.822382 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.822009    2577 scope.go:117] "RemoveContainer" containerID="1a0bc89b9d6dbacda2bff1657cd3659553d611ff095d27e43f9239f9e5d7a8ba"
Jul 21 16:27:05.864648 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.864617    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d657c8f66-642zq"]
Jul 21 16:27:05.868311 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:05.868289    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d657c8f66-642zq"]
Jul 21 16:27:06.189088 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:06.189042    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f174afdc-2505-4b5a-8162-72030e534368" path="/var/lib/kubelet/pods/f174afdc-2505-4b5a-8162-72030e534368/volumes"
Jul 21 16:27:24.977379 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:24.977326    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:27:24.995857 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:24.995831    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:27:25.911817 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:27:25.911791    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 21 16:29:51.121396 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121358    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"]
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121638    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121649    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121659    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f174afdc-2505-4b5a-8162-72030e534368" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121667    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f174afdc-2505-4b5a-8162-72030e534368" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121679    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92595b56-9b65-4dd2-89ab-f1c28b778c2b" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121686    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="92595b56-9b65-4dd2-89ab-f1c28b778c2b" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121731    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0db0bc83-cdcf-44d2-a4ca-22b5930b0f48" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121738    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="92595b56-9b65-4dd2-89ab-f1c28b778c2b" containerName="console"
Jul 21 16:29:51.121812 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.121745    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f174afdc-2505-4b5a-8162-72030e534368" containerName="console"
Jul 21 16:29:51.124303 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.124285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.126787 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.126705    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 21 16:29:51.127172 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.127151    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 21 16:29:51.127562 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.127220    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2dmv6\""
Jul 21 16:29:51.127704 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.127680    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 21 16:29:51.128486 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.128465    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 21 16:29:51.167585 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.167554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"]
Jul 21 16:29:51.199446 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.199417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/526ff9e0-e7b8-4cfa-a06b-605c19909578-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.199591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.199450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwbgm\" (UniqueName: \"kubernetes.io/projected/526ff9e0-e7b8-4cfa-a06b-605c19909578-kube-api-access-dwbgm\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.199591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.199569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/526ff9e0-e7b8-4cfa-a06b-605c19909578-manifests\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.199671 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.199611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/526ff9e0-e7b8-4cfa-a06b-605c19909578-tmp\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.199671 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.199631    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/526ff9e0-e7b8-4cfa-a06b-605c19909578-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.300842 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.300811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/526ff9e0-e7b8-4cfa-a06b-605c19909578-manifests\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.301006 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.300854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/526ff9e0-e7b8-4cfa-a06b-605c19909578-tmp\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.301006 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.300871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/526ff9e0-e7b8-4cfa-a06b-605c19909578-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.301101 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.301001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/526ff9e0-e7b8-4cfa-a06b-605c19909578-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.301101 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.301035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwbgm\" (UniqueName: \"kubernetes.io/projected/526ff9e0-e7b8-4cfa-a06b-605c19909578-kube-api-access-dwbgm\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.301373 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.301342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/526ff9e0-e7b8-4cfa-a06b-605c19909578-manifests\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.303290 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.303258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/526ff9e0-e7b8-4cfa-a06b-605c19909578-tmp\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.303399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.303336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/526ff9e0-e7b8-4cfa-a06b-605c19909578-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.303399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.303380    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/526ff9e0-e7b8-4cfa-a06b-605c19909578-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.309867 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.309827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwbgm\" (UniqueName: \"kubernetes.io/projected/526ff9e0-e7b8-4cfa-a06b-605c19909578-kube-api-access-dwbgm\") pod \"opendatahub-operator-controller-manager-7d658cff7b-5zp8r\" (UID: \"526ff9e0-e7b8-4cfa-a06b-605c19909578\") " pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.436676 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.436596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:51.570919 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:51.570883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"]
Jul 21 16:29:51.574183 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:29:51.574152    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526ff9e0_e7b8_4cfa_a06b_605c19909578.slice/crio-d9502c0fa24a31781f016884c8d42d89e891d39129fab3028f1e429b477c634d WatchSource:0}: Error finding container d9502c0fa24a31781f016884c8d42d89e891d39129fab3028f1e429b477c634d: Status 404 returned error can't find the container with id d9502c0fa24a31781f016884c8d42d89e891d39129fab3028f1e429b477c634d
Jul 21 16:29:52.410771 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:52.410725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r" event={"ID":"526ff9e0-e7b8-4cfa-a06b-605c19909578","Type":"ContainerStarted","Data":"d9502c0fa24a31781f016884c8d42d89e891d39129fab3028f1e429b477c634d"}
Jul 21 16:29:55.426350 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:55.426314    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r" event={"ID":"526ff9e0-e7b8-4cfa-a06b-605c19909578","Type":"ContainerStarted","Data":"c60307d52d17b083e279c6e641a7723912667d9791ccff241a89274e2e5cdb24"}
Jul 21 16:29:56.431508 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:56.431474    2577 generic.go:356] "Generic (PLEG): container finished" podID="526ff9e0-e7b8-4cfa-a06b-605c19909578" containerID="c60307d52d17b083e279c6e641a7723912667d9791ccff241a89274e2e5cdb24" exitCode=0
Jul 21 16:29:56.431877 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:56.431514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r" event={"ID":"526ff9e0-e7b8-4cfa-a06b-605c19909578","Type":"ContainerDied","Data":"c60307d52d17b083e279c6e641a7723912667d9791ccff241a89274e2e5cdb24"}
Jul 21 16:29:57.437500 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:57.437467    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r" event={"ID":"526ff9e0-e7b8-4cfa-a06b-605c19909578","Type":"ContainerStarted","Data":"ad6adc795605bc48eb883c61ff97efed98772a9ffcea249a2c7ebe20393afb7c"}
Jul 21 16:29:57.437869 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:57.437579    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:29:57.463385 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:29:57.463336    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r" podStartSLOduration=1.858830252 podStartE2EDuration="6.463320743s" totalImagesPullingTime="3.570508758s" totalInitContainerRuntime="1.033981733s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:29:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:29:57.459807753 +0000 UTC m=+293.800727615" watchObservedRunningTime="2026-07-21 16:29:57.463320743 +0000 UTC m=+293.804240661"
Jul 21 16:30:03.986690 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:03.986656    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:30:03.990368 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:03.990336    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 16:30:03.997281 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:03.997262    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:30:08.444115 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:08.444082    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d658cff7b-5zp8r"
Jul 21 16:30:17.571078 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.571043    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"]
Jul 21 16:30:17.573290 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.573269    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.576472 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.576447    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 21 16:30:17.576472 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.576465    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 21 16:30:17.576657 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.576477    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 21 16:30:17.576657 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.576498    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 21 16:30:17.576657 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.576477    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-wql69\""
Jul 21 16:30:17.576657 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.576452    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 21 16:30:17.584383 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.584365    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"]
Jul 21 16:30:17.726532 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.726470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177c2845-5675-47ae-a8a7-76c7fd3a2e36-cert\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.726682 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.726547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/177c2845-5675-47ae-a8a7-76c7fd3a2e36-metrics-cert\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.726682 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.726568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/177c2845-5675-47ae-a8a7-76c7fd3a2e36-manager-config\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.726682 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.726590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztp8z\" (UniqueName: \"kubernetes.io/projected/177c2845-5675-47ae-a8a7-76c7fd3a2e36-kube-api-access-ztp8z\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.827888 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.827793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177c2845-5675-47ae-a8a7-76c7fd3a2e36-cert\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.827888 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.827845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/177c2845-5675-47ae-a8a7-76c7fd3a2e36-metrics-cert\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.828113 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.827917    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/177c2845-5675-47ae-a8a7-76c7fd3a2e36-manager-config\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.828113 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.827966    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztp8z\" (UniqueName: \"kubernetes.io/projected/177c2845-5675-47ae-a8a7-76c7fd3a2e36-kube-api-access-ztp8z\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.828600 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.828577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/177c2845-5675-47ae-a8a7-76c7fd3a2e36-manager-config\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.830295 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.830276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/177c2845-5675-47ae-a8a7-76c7fd3a2e36-metrics-cert\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.830404 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.830389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/177c2845-5675-47ae-a8a7-76c7fd3a2e36-cert\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.835661 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.835640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztp8z\" (UniqueName: \"kubernetes.io/projected/177c2845-5675-47ae-a8a7-76c7fd3a2e36-kube-api-access-ztp8z\") pod \"lws-controller-manager-76fbb8f576-pnsm6\" (UID: \"177c2845-5675-47ae-a8a7-76c7fd3a2e36\") " pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:17.882650 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:17.882603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:18.014721 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:18.014689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"]
Jul 21 16:30:18.017746 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:30:18.017718    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177c2845_5675_47ae_a8a7_76c7fd3a2e36.slice/crio-81fa5fd78a1a7a1818c40b1dc61fce126eccde3ebeea4f7ee9972e59f3057256 WatchSource:0}: Error finding container 81fa5fd78a1a7a1818c40b1dc61fce126eccde3ebeea4f7ee9972e59f3057256: Status 404 returned error can't find the container with id 81fa5fd78a1a7a1818c40b1dc61fce126eccde3ebeea4f7ee9972e59f3057256
Jul 21 16:30:18.019748 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:18.019728    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:30:18.515621 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:18.515584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6" event={"ID":"177c2845-5675-47ae-a8a7-76c7fd3a2e36","Type":"ContainerStarted","Data":"81fa5fd78a1a7a1818c40b1dc61fce126eccde3ebeea4f7ee9972e59f3057256"}
Jul 21 16:30:21.148025 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.147990    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"]
Jul 21 16:30:21.151257 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.151230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.154771 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.154747    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 21 16:30:21.154983 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.154750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 21 16:30:21.155080 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.155063    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xh285\""
Jul 21 16:30:21.155530 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.155513    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 21 16:30:21.158180 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.158162    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 21 16:30:21.174415 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.174384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"]
Jul 21 16:30:21.259552 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.259526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tls-certs\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.259682 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.259581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbvcm\" (UniqueName: \"kubernetes.io/projected/be8cd6f0-1bf6-4b68-bafa-841653d5a332-kube-api-access-fbvcm\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.259721 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.259704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tmp\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.360925 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.360885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tmp\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.361088 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.360963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tls-certs\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.361088 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.361019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbvcm\" (UniqueName: \"kubernetes.io/projected/be8cd6f0-1bf6-4b68-bafa-841653d5a332-kube-api-access-fbvcm\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.361236 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:30:21.361158    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 21 16:30:21.361286 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:30:21.361239    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tls-certs podName:be8cd6f0-1bf6-4b68-bafa-841653d5a332 nodeName:}" failed. No retries permitted until 2026-07-21 16:30:21.86121739 +0000 UTC m=+318.202137248 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tls-certs") pod "kube-auth-proxy-6dcb5fbcb6-hvg2s" (UID: "be8cd6f0-1bf6-4b68-bafa-841653d5a332") : secret "kube-auth-proxy-tls" not found
Jul 21 16:30:21.363266 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.363247    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tmp\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.373007 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.372983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbvcm\" (UniqueName: \"kubernetes.io/projected/be8cd6f0-1bf6-4b68-bafa-841653d5a332-kube-api-access-fbvcm\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.530344 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.530299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6" event={"ID":"177c2845-5675-47ae-a8a7-76c7fd3a2e36","Type":"ContainerStarted","Data":"6c506891ed26020ba423e9e56e6cd2798ac73fd3507061b2515fd4c6332261d1"}
Jul 21 16:30:21.530500 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.530398    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:30:21.549388 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.549329    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6" podStartSLOduration=1.53547016 podStartE2EDuration="4.54930845s" totalImagesPullingTime="3.01383829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:21.547463726 +0000 UTC m=+317.888383589" watchObservedRunningTime="2026-07-21 16:30:21.54930845 +0000 UTC m=+317.890228314"
Jul 21 16:30:21.865778 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.865740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tls-certs\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:21.868110 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:21.868083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be8cd6f0-1bf6-4b68-bafa-841653d5a332-tls-certs\") pod \"kube-auth-proxy-6dcb5fbcb6-hvg2s\" (UID: \"be8cd6f0-1bf6-4b68-bafa-841653d5a332\") " pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:22.061491 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:22.061452    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"
Jul 21 16:30:22.190759 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:22.190595    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s"]
Jul 21 16:30:22.193194 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:30:22.193170    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe8cd6f0_1bf6_4b68_bafa_841653d5a332.slice/crio-4e0707b3dd60c380e1c94403a8a79c77120aa03a75f6f0af331b4d2d753b2571 WatchSource:0}: Error finding container 4e0707b3dd60c380e1c94403a8a79c77120aa03a75f6f0af331b4d2d753b2571: Status 404 returned error can't find the container with id 4e0707b3dd60c380e1c94403a8a79c77120aa03a75f6f0af331b4d2d753b2571
Jul 21 16:30:22.535317 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:22.535236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s" event={"ID":"be8cd6f0-1bf6-4b68-bafa-841653d5a332","Type":"ContainerStarted","Data":"4e0707b3dd60c380e1c94403a8a79c77120aa03a75f6f0af331b4d2d753b2571"}
Jul 21 16:30:26.551637 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:26.551601    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s" event={"ID":"be8cd6f0-1bf6-4b68-bafa-841653d5a332","Type":"ContainerStarted","Data":"ad5c03dff91d9f9b71b84583376cbf650c602e1beb12f416dde166061a85c701"}
Jul 21 16:30:26.566961 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:26.566912    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6dcb5fbcb6-hvg2s" podStartSLOduration=1.9332153810000001 podStartE2EDuration="5.56689699s" totalImagesPullingTime="3.633681609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:30:26.565990356 +0000 UTC m=+322.906910230" watchObservedRunningTime="2026-07-21 16:30:26.56689699 +0000 UTC m=+322.907816853"
Jul 21 16:30:32.538245 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:30:32.538217    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76fbb8f576-pnsm6"
Jul 21 16:32:04.826194 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.826153    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"]
Jul 21 16:32:04.828772 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.828754    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:04.831584 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.831560    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 21 16:32:04.831793 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.831771    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 21 16:32:04.832066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.832051    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 21 16:32:04.833013 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.832996    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 21 16:32:04.836831 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.836816    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tztzv\""
Jul 21 16:32:04.842499 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.842476    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"]
Jul 21 16:32:04.939634 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.939597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:04.939808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.939664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xftdk\" (UniqueName: \"kubernetes.io/projected/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-kube-api-access-xftdk\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:04.939808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:04.939698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.041184 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.041144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftdk\" (UniqueName: \"kubernetes.io/projected/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-kube-api-access-xftdk\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.041184 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.041182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.041377 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.041232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.041829 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.041812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.043518 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.043496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.049886 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.049862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xftdk\" (UniqueName: \"kubernetes.io/projected/7932aea6-a71b-4b6e-a1f5-fb7d3547b55e-kube-api-access-xftdk\") pod \"kuadrant-console-plugin-66b5774985-x9mvp\" (UID: \"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.137805 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.137772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"
Jul 21 16:32:05.266752 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.266701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp"]
Jul 21 16:32:05.269688 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:32:05.269663    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7932aea6_a71b_4b6e_a1f5_fb7d3547b55e.slice/crio-dd48acef79d7ea5df8f0f76736410e56e2b5e3fb42d558abc98a7c0543525fa1 WatchSource:0}: Error finding container dd48acef79d7ea5df8f0f76736410e56e2b5e3fb42d558abc98a7c0543525fa1: Status 404 returned error can't find the container with id dd48acef79d7ea5df8f0f76736410e56e2b5e3fb42d558abc98a7c0543525fa1
Jul 21 16:32:05.923591 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:05.923560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp" event={"ID":"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e","Type":"ContainerStarted","Data":"dd48acef79d7ea5df8f0f76736410e56e2b5e3fb42d558abc98a7c0543525fa1"}
Jul 21 16:32:29.024651 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:29.024615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp" event={"ID":"7932aea6-a71b-4b6e-a1f5-fb7d3547b55e","Type":"ContainerStarted","Data":"f437930d02b741719e1634723de8c55b2a00230b801dc6429e5c6f948be8b1ee"}
Jul 21 16:32:29.055709 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:29.055651    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x9mvp" podStartSLOduration=2.355205973 podStartE2EDuration="25.055632591s" totalImagesPullingTime="22.700426618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:29.053424437 +0000 UTC m=+445.394344301" watchObservedRunningTime="2026-07-21 16:32:29.055632591 +0000 UTC m=+445.396552455"
Jul 21 16:32:52.040207 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.040168    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:32:52.109254 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.109220    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:32:52.109435 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.109269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:32:52.109435 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.109345    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.111590 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.111565    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 21 16:32:52.260495 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.260451    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf942\" (UniqueName: \"kubernetes.io/projected/091d7e92-5072-4e7f-a36b-55284655847a-kube-api-access-kf942\") pod \"limitador-limitador-54d6d988d5-cz97t\" (UID: \"091d7e92-5072-4e7f-a36b-55284655847a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.260663 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.260575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/091d7e92-5072-4e7f-a36b-55284655847a-config-file\") pod \"limitador-limitador-54d6d988d5-cz97t\" (UID: \"091d7e92-5072-4e7f-a36b-55284655847a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.361645 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.361611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/091d7e92-5072-4e7f-a36b-55284655847a-config-file\") pod \"limitador-limitador-54d6d988d5-cz97t\" (UID: \"091d7e92-5072-4e7f-a36b-55284655847a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.361809 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.361677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf942\" (UniqueName: \"kubernetes.io/projected/091d7e92-5072-4e7f-a36b-55284655847a-kube-api-access-kf942\") pod \"limitador-limitador-54d6d988d5-cz97t\" (UID: \"091d7e92-5072-4e7f-a36b-55284655847a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.362355 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.362335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/091d7e92-5072-4e7f-a36b-55284655847a-config-file\") pod \"limitador-limitador-54d6d988d5-cz97t\" (UID: \"091d7e92-5072-4e7f-a36b-55284655847a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.370304 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.370276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf942\" (UniqueName: \"kubernetes.io/projected/091d7e92-5072-4e7f-a36b-55284655847a-kube-api-access-kf942\") pod \"limitador-limitador-54d6d988d5-cz97t\" (UID: \"091d7e92-5072-4e7f-a36b-55284655847a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.423267 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.423236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:52.601882 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:52.601847    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:32:52.605154 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:32:52.605102    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091d7e92_5072_4e7f_a36b_55284655847a.slice/crio-aeb6d1a21ff05ebbdaf35c3473a3fb1d16455e83609afaf0fb3799543fbd91a8 WatchSource:0}: Error finding container aeb6d1a21ff05ebbdaf35c3473a3fb1d16455e83609afaf0fb3799543fbd91a8: Status 404 returned error can't find the container with id aeb6d1a21ff05ebbdaf35c3473a3fb1d16455e83609afaf0fb3799543fbd91a8
Jul 21 16:32:53.122092 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:53.122003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t" event={"ID":"091d7e92-5072-4e7f-a36b-55284655847a","Type":"ContainerStarted","Data":"aeb6d1a21ff05ebbdaf35c3473a3fb1d16455e83609afaf0fb3799543fbd91a8"}
Jul 21 16:32:57.142973 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:57.142933    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t" event={"ID":"091d7e92-5072-4e7f-a36b-55284655847a","Type":"ContainerStarted","Data":"2c9821e530ee70b3e19a55d9a9f5810fc960cf071bb6bb5cb67d98dfc0123d83"}
Jul 21 16:32:57.143461 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:57.143058    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:32:57.158139 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:32:57.158073    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t" podStartSLOduration=1.3009858539999999 podStartE2EDuration="5.158057221s" totalImagesPullingTime="3.857071367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:57.157115566 +0000 UTC m=+473.498035426" watchObservedRunningTime="2026-07-21 16:32:57.158057221 +0000 UTC m=+473.498977078"
Jul 21 16:33:08.148845 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:33:08.148809    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-cz97t"
Jul 21 16:34:08.401111 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:08.401033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:34:32.791925 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:32.791882    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:34:46.493777 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:46.493741    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:34:58.974323 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.974293    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"]
Jul 21 16:34:58.976361 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.976345    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:58.979183 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.979161    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 21 16:34:58.979310 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.979186    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 21 16:34:58.979310 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.979208    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kk782\""
Jul 21 16:34:58.979310 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.979185    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 21 16:34:58.987441 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:58.987419    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"]
Jul 21 16:34:59.066731 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.066700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.066731 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.066733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.066948 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.066758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ea25f0-a7a5-4f82-8201-46fe0758917e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.066948 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.066779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.066948 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.066798    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.066948 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.066848    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6t6hq\" (UniqueName: \"kubernetes.io/projected/36ea25f0-a7a5-4f82-8201-46fe0758917e-kube-api-access-6t6hq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168204 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168398 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168211    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168398 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ea25f0-a7a5-4f82-8201-46fe0758917e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168398 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168573 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168573 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6t6hq\" (UniqueName: \"kubernetes.io/projected/36ea25f0-a7a5-4f82-8201-46fe0758917e-kube-api-access-6t6hq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168686 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168794 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.168843 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.168808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.170541 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.170520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36ea25f0-a7a5-4f82-8201-46fe0758917e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.170872 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.170852    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36ea25f0-a7a5-4f82-8201-46fe0758917e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.175529 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.175501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6t6hq\" (UniqueName: \"kubernetes.io/projected/36ea25f0-a7a5-4f82-8201-46fe0758917e-kube-api-access-6t6hq\") pod \"e2e-trlp-test-simulated-kserve-598466548d-krqmz\" (UID: \"36ea25f0-a7a5-4f82-8201-46fe0758917e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.286855 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.286768    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:34:59.415725 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.415692    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"]
Jul 21 16:34:59.419021 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:34:59.418988    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36ea25f0_a7a5_4f82_8201_46fe0758917e.slice/crio-1ab8af8942e732623e2a44a9bd497ff81ae6d86a904d16280989eccae595e5f6 WatchSource:0}: Error finding container 1ab8af8942e732623e2a44a9bd497ff81ae6d86a904d16280989eccae595e5f6: Status 404 returned error can't find the container with id 1ab8af8942e732623e2a44a9bd497ff81ae6d86a904d16280989eccae595e5f6
Jul 21 16:34:59.633842 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:34:59.633806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz" event={"ID":"36ea25f0-a7a5-4f82-8201-46fe0758917e","Type":"ContainerStarted","Data":"1ab8af8942e732623e2a44a9bd497ff81ae6d86a904d16280989eccae595e5f6"}
Jul 21 16:35:00.008106 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:00.008004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:35:00.639399 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:00.639357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz" event={"ID":"36ea25f0-a7a5-4f82-8201-46fe0758917e","Type":"ContainerStarted","Data":"25bd29dc3d832fa5340d52048a9a2749188f2397f7f99a8c0164e0abb5a28de6"}
Jul 21 16:35:00.656890 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:00.656783    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz" podStartSLOduration=1.673879428 podStartE2EDuration="2.656766231s" totalImagesPullingTime="982.886803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:00.655034764 +0000 UTC m=+596.995954627" watchObservedRunningTime="2026-07-21 16:35:00.656766231 +0000 UTC m=+596.997686093"
Jul 21 16:35:04.019252 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:04.019221    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:35:04.022694 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:04.022672    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:35:05.095938 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:05.095899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:35:09.287168 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:09.287133    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:35:09.288407 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:09.287199    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:35:09.299666 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:09.299647    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:35:09.686978 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:09.686942    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-krqmz"
Jul 21 16:35:20.299986 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:20.299949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:35:29.088181 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.088085    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"]
Jul 21 16:35:29.090817 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.090795    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.093321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.093298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 21 16:35:29.102091 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.102066    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"]
Jul 21 16:35:29.138199 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.138167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.138342 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.138201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.138342 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.138231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.138342 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.138317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86ln\" (UniqueName: \"kubernetes.io/projected/84eae28b-814b-4bda-b122-37d50b55a8be-kube-api-access-v86ln\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.138459 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.138404    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.138459 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.138432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84eae28b-814b-4bda-b122-37d50b55a8be-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239175 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239175 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239417 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239417 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86ln\" (UniqueName: \"kubernetes.io/projected/84eae28b-814b-4bda-b122-37d50b55a8be-kube-api-access-v86ln\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239417 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239417 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84eae28b-814b-4bda-b122-37d50b55a8be-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239611 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239588    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239690 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.239690 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.239689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.241451 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.241429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/84eae28b-814b-4bda-b122-37d50b55a8be-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.241720 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.241701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/84eae28b-814b-4bda-b122-37d50b55a8be-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.246910 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.246887    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86ln\" (UniqueName: \"kubernetes.io/projected/84eae28b-814b-4bda-b122-37d50b55a8be-kube-api-access-v86ln\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz\" (UID: \"84eae28b-814b-4bda-b122-37d50b55a8be\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.400621 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.400521    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:29.527808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.527765    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"]
Jul 21 16:35:29.530770 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:35:29.530743    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84eae28b_814b_4bda_b122_37d50b55a8be.slice/crio-4929ac7ae2e4e57108695efcc24c62164a873f61fb17b36c288f64c2506f9931 WatchSource:0}: Error finding container 4929ac7ae2e4e57108695efcc24c62164a873f61fb17b36c288f64c2506f9931: Status 404 returned error can't find the container with id 4929ac7ae2e4e57108695efcc24c62164a873f61fb17b36c288f64c2506f9931
Jul 21 16:35:29.532212 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.532192    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:35:29.759272 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:29.759246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz" event={"ID":"84eae28b-814b-4bda-b122-37d50b55a8be","Type":"ContainerStarted","Data":"4929ac7ae2e4e57108695efcc24c62164a873f61fb17b36c288f64c2506f9931"}
Jul 21 16:35:30.765055 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:30.765003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz" event={"ID":"84eae28b-814b-4bda-b122-37d50b55a8be","Type":"ContainerStarted","Data":"6127af4076d4b4f1aafa30c06ffcb3b7633dcb52a498da333bc36b43cba077e4"}
Jul 21 16:35:30.781904 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:30.781862    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz" podStartSLOduration=1.5734048459999999 podStartE2EDuration="1.781846191s" totalImagesPullingTime="208.441345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:30.780441842 +0000 UTC m=+627.121361716" watchObservedRunningTime="2026-07-21 16:35:30.781846191 +0000 UTC m=+627.122766032"
Jul 21 16:35:32.102986 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:32.102950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:35:39.401642 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:39.401597    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:39.401642 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:39.401649    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:39.413936 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:39.413902    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:35:39.813543 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:35:39.813463    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz"
Jul 21 16:36:47.501516 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:36:47.501479    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:36:58.393274 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:36:58.393190    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:37:08.799347 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:37:08.799314    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:38:49.637779 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:38:49.637743    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:39:01.503096 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:39:01.503058    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:39:36.796766 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:39:36.796734    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:39:46.898550 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:39:46.898516    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:39:55.892232 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:39:55.892150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:40:04.044902 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:04.044873    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:40:04.046173 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:04.046150    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:40:06.705871 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:06.705833    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:40:16.030643 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:16.030602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:40:27.587460 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:27.587423    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:40:38.627893 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:38.627854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:40:46.925577 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:40:46.925537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:41:09.464770 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:41:09.464735    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:41:18.805534 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:41:18.805493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:41:42.805592 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:41:42.805502    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:41:54.593375 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:41:54.593337    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:42:11.196930 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:42:11.196891    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:42:20.993079 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:42:20.989382    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:42:30.396754 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:42:30.396711    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:42:39.882325 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:42:39.882289    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:42:47.990685 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:42:47.990650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:44:37.690726 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:44:37.690689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:44:49.490743 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:44:49.490707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:44:58.383921 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:44:58.383883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:45:04.070630 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:04.070598    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:45:04.071221 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:04.070769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:45:09.698219 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:09.698183    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:45:20.183856 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:20.183816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:45:32.086630 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:32.086589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:45:41.086309 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:41.086273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:45:51.891212 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:45:51.891173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:46:02.783651 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:02.783567    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:46:11.787013 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:11.786975    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:46:22.294057 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:22.294025    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:46:47.101469 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:47.101433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:46:54.201489 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.201457    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"]
Jul 21 16:46:54.203739 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.203717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:46:54.203857 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.203828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.206062 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.206042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e2b86d07-kserve-self-signed-certs\""
Jul 21 16:46:54.221291 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.221263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"]
Jul 21 16:46:54.286875 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.286840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-home\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.287066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.286886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-dshm\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.287066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.286993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pvhq\" (UniqueName: \"kubernetes.io/projected/a4ca41f9-e2db-49fe-824d-3779eb1119a6-kube-api-access-7pvhq\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.287066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.287047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tmp-dir\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.287241 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.287078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-model-cache\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.287241 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.287163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tls-certs\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.388555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tmp-dir\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.388555 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-model-cache\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.388813 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tls-certs\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.388813 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388622    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-home\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.388813 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-dshm\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.388813 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pvhq\" (UniqueName: \"kubernetes.io/projected/a4ca41f9-e2db-49fe-824d-3779eb1119a6-kube-api-access-7pvhq\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.389020 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.388975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tmp-dir\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.389020 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.389009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-model-cache\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.389100 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.389065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-home\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.390982 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.390958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-dshm\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.391200 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.391182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tls-certs\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.399094 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.399073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pvhq\" (UniqueName: \"kubernetes.io/projected/a4ca41f9-e2db-49fe-824d-3779eb1119a6-kube-api-access-7pvhq\") pod \"e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") " pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.513084 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.513010    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:46:54.639997 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:54.639971    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"]
Jul 21 16:46:54.642348 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:46:54.642322    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4ca41f9_e2db_49fe_824d_3779eb1119a6.slice/crio-c21f8dc48b46f68d2aea43d2a4a1b873127d889980b6186f8272b8396c7f5856 WatchSource:0}: Error finding container c21f8dc48b46f68d2aea43d2a4a1b873127d889980b6186f8272b8396c7f5856: Status 404 returned error can't find the container with id c21f8dc48b46f68d2aea43d2a4a1b873127d889980b6186f8272b8396c7f5856
Jul 21 16:46:55.608331 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:55.608283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv" event={"ID":"a4ca41f9-e2db-49fe-824d-3779eb1119a6","Type":"ContainerStarted","Data":"20a143e6c72cee480a619b892f46bdb13e79644ba6e1ec242bf1c9cfdf92d582"}
Jul 21 16:46:55.608723 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:55.608348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv" event={"ID":"a4ca41f9-e2db-49fe-824d-3779eb1119a6","Type":"ContainerStarted","Data":"c21f8dc48b46f68d2aea43d2a4a1b873127d889980b6186f8272b8396c7f5856"}
Jul 21 16:46:55.624070 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:46:55.624022    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv" podStartSLOduration=1.624007186 podStartE2EDuration="1.624007186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:46:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:46:55.62261103 +0000 UTC m=+1311.963530905" watchObservedRunningTime="2026-07-21 16:46:55.624007186 +0000 UTC m=+1311.964927048"
Jul 21 16:47:02.981252 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:02.981215    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"]
Jul 21 16:47:02.984621 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:02.984600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:02.986639 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:02.986616    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e2b86d07-kserve-self-signed-certs\""
Jul 21 16:47:02.991521 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:02.991497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"]
Jul 21 16:47:03.069627 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.069590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-dshm\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.069808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.069648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd3efbe-f926-4843-aec8-d7afbe309af5-tls-certs\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.069808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.069722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd9w4\" (UniqueName: \"kubernetes.io/projected/3fd3efbe-f926-4843-aec8-d7afbe309af5-kube-api-access-cd9w4\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.069808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.069754    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-home\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.069808 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.069786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-model-cache\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.069953 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.069833    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-tmp-dir\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171214 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171182    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd3efbe-f926-4843-aec8-d7afbe309af5-tls-certs\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171400 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd9w4\" (UniqueName: \"kubernetes.io/projected/3fd3efbe-f926-4843-aec8-d7afbe309af5-kube-api-access-cd9w4\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171400 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-home\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171400 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-model-cache\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171400 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-tmp-dir\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171603 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-dshm\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171766 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-home\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171858 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-tmp-dir\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.171858 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.171834    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-model-cache\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.173689 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.173655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-dshm\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.173751 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.173732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd3efbe-f926-4843-aec8-d7afbe309af5-tls-certs\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.178364 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.178341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd9w4\" (UniqueName: \"kubernetes.io/projected/3fd3efbe-f926-4843-aec8-d7afbe309af5-kube-api-access-cd9w4\") pod \"e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") " pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.296261 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.296177    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:03.422937 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.422913    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"]
Jul 21 16:47:03.425306 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:47:03.425276    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fd3efbe_f926_4843_aec8_d7afbe309af5.slice/crio-77b65c4eda54a7c65ca679675e9d30a942f75622c2659a184ddc7fcd2a89d9a4 WatchSource:0}: Error finding container 77b65c4eda54a7c65ca679675e9d30a942f75622c2659a184ddc7fcd2a89d9a4: Status 404 returned error can't find the container with id 77b65c4eda54a7c65ca679675e9d30a942f75622c2659a184ddc7fcd2a89d9a4
Jul 21 16:47:03.643703 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.643669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2" event={"ID":"3fd3efbe-f926-4843-aec8-d7afbe309af5","Type":"ContainerStarted","Data":"a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3"}
Jul 21 16:47:03.643856 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.643715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2" event={"ID":"3fd3efbe-f926-4843-aec8-d7afbe309af5","Type":"ContainerStarted","Data":"77b65c4eda54a7c65ca679675e9d30a942f75622c2659a184ddc7fcd2a89d9a4"}
Jul 21 16:47:03.661157 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:03.661091    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2" podStartSLOduration=1.661075978 podStartE2EDuration="1.661075978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:47:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:47:03.659576573 +0000 UTC m=+1320.000496430" watchObservedRunningTime="2026-07-21 16:47:03.661075978 +0000 UTC m=+1320.001995841"
Jul 21 16:47:04.513291 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:04.513204    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:47:04.513291 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:04.513266    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:47:04.525775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:04.525747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:47:04.659443 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:04.659416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:47:07.289894 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:07.289854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:47:13.297019 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:13.296986    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:13.297515 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:13.297033    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:13.309662 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:13.309638    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:13.695687 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:13.695655    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:36.647012 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:36.646936    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"]
Jul 21 16:47:38.182514 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:38.182478    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"]
Jul 21 16:47:38.481884 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:38.481796    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:47:50.088333 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:50.088295    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:47:51.667182 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:51.667141    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv" podUID="a4ca41f9-e2db-49fe-824d-3779eb1119a6" containerName="main" containerID="cri-o://20a143e6c72cee480a619b892f46bdb13e79644ba6e1ec242bf1c9cfdf92d582" gracePeriod=45
Jul 21 16:47:51.849728 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:51.849694    2577 generic.go:356] "Generic (PLEG): container finished" podID="a4ca41f9-e2db-49fe-824d-3779eb1119a6" containerID="20a143e6c72cee480a619b892f46bdb13e79644ba6e1ec242bf1c9cfdf92d582" exitCode=0
Jul 21 16:47:51.849878 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:51.849768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv" event={"ID":"a4ca41f9-e2db-49fe-824d-3779eb1119a6","Type":"ContainerDied","Data":"20a143e6c72cee480a619b892f46bdb13e79644ba6e1ec242bf1c9cfdf92d582"}
Jul 21 16:47:51.909255 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:51.909233    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:47:52.007449 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007364    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tmp-dir\") pod \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") "
Jul 21 16:47:52.007449 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007424    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tls-certs\") pod \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") "
Jul 21 16:47:52.007449 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007444    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-home\") pod \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") "
Jul 21 16:47:52.007708 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007475    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-dshm\") pod \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") "
Jul 21 16:47:52.007708 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007493    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pvhq\" (UniqueName: \"kubernetes.io/projected/a4ca41f9-e2db-49fe-824d-3779eb1119a6-kube-api-access-7pvhq\") pod \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") "
Jul 21 16:47:52.007708 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-model-cache\") pod \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\" (UID: \"a4ca41f9-e2db-49fe-824d-3779eb1119a6\") "
Jul 21 16:47:52.007708 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007654    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a4ca41f9-e2db-49fe-824d-3779eb1119a6" (UID: "a4ca41f9-e2db-49fe-824d-3779eb1119a6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:52.007983 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-home" (OuterVolumeSpecName: "home") pod "a4ca41f9-e2db-49fe-824d-3779eb1119a6" (UID: "a4ca41f9-e2db-49fe-824d-3779eb1119a6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:52.007983 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007900    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:52.007983 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007924    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:52.007983 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.007943    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-model-cache" (OuterVolumeSpecName: "model-cache") pod "a4ca41f9-e2db-49fe-824d-3779eb1119a6" (UID: "a4ca41f9-e2db-49fe-824d-3779eb1119a6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:52.009775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.009754    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-dshm" (OuterVolumeSpecName: "dshm") pod "a4ca41f9-e2db-49fe-824d-3779eb1119a6" (UID: "a4ca41f9-e2db-49fe-824d-3779eb1119a6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:52.009877 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.009807    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ca41f9-e2db-49fe-824d-3779eb1119a6-kube-api-access-7pvhq" (OuterVolumeSpecName: "kube-api-access-7pvhq") pod "a4ca41f9-e2db-49fe-824d-3779eb1119a6" (UID: "a4ca41f9-e2db-49fe-824d-3779eb1119a6"). InnerVolumeSpecName "kube-api-access-7pvhq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:47:52.009877 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.009814    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a4ca41f9-e2db-49fe-824d-3779eb1119a6" (UID: "a4ca41f9-e2db-49fe-824d-3779eb1119a6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:47:52.108824 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.108786    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:52.108824 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.108814    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a4ca41f9-e2db-49fe-824d-3779eb1119a6-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:52.108824 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.108824    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a4ca41f9-e2db-49fe-824d-3779eb1119a6-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:52.109024 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.108833    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pvhq\" (UniqueName: \"kubernetes.io/projected/a4ca41f9-e2db-49fe-824d-3779eb1119a6-kube-api-access-7pvhq\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:52.854846 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.854810    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"
Jul 21 16:47:52.855307 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.854814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv" event={"ID":"a4ca41f9-e2db-49fe-824d-3779eb1119a6","Type":"ContainerDied","Data":"c21f8dc48b46f68d2aea43d2a4a1b873127d889980b6186f8272b8396c7f5856"}
Jul 21 16:47:52.855307 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.854929    2577 scope.go:117] "RemoveContainer" containerID="20a143e6c72cee480a619b892f46bdb13e79644ba6e1ec242bf1c9cfdf92d582"
Jul 21 16:47:52.869055 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.869033    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"]
Jul 21 16:47:52.872783 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:52.872760    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e2b86d07-kserve-66445d46c-nxmwv"]
Jul 21 16:47:53.204537 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.204445    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2" podUID="3fd3efbe-f926-4843-aec8-d7afbe309af5" containerName="main" containerID="cri-o://a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3" gracePeriod=45
Jul 21 16:47:53.456564 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.456506    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:53.520187 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520155    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd3efbe-f926-4843-aec8-d7afbe309af5-tls-certs\") pod \"3fd3efbe-f926-4843-aec8-d7afbe309af5\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") "
Jul 21 16:47:53.520359 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520257    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-tmp-dir\") pod \"3fd3efbe-f926-4843-aec8-d7afbe309af5\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") "
Jul 21 16:47:53.520359 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520287    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-dshm\") pod \"3fd3efbe-f926-4843-aec8-d7afbe309af5\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") "
Jul 21 16:47:53.520359 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520339    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-home\") pod \"3fd3efbe-f926-4843-aec8-d7afbe309af5\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") "
Jul 21 16:47:53.520533 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520396    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd9w4\" (UniqueName: \"kubernetes.io/projected/3fd3efbe-f926-4843-aec8-d7afbe309af5-kube-api-access-cd9w4\") pod \"3fd3efbe-f926-4843-aec8-d7afbe309af5\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") "
Jul 21 16:47:53.520533 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520422    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-model-cache\") pod \"3fd3efbe-f926-4843-aec8-d7afbe309af5\" (UID: \"3fd3efbe-f926-4843-aec8-d7afbe309af5\") "
Jul 21 16:47:53.520646 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520563    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fd3efbe-f926-4843-aec8-d7afbe309af5" (UID: "3fd3efbe-f926-4843-aec8-d7afbe309af5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:53.520646 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-home" (OuterVolumeSpecName: "home") pod "3fd3efbe-f926-4843-aec8-d7afbe309af5" (UID: "3fd3efbe-f926-4843-aec8-d7afbe309af5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:53.520765 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520718    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:53.520802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520772    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:53.520802 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.520789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fd3efbe-f926-4843-aec8-d7afbe309af5" (UID: "3fd3efbe-f926-4843-aec8-d7afbe309af5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:53.522409 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.522385    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-dshm" (OuterVolumeSpecName: "dshm") pod "3fd3efbe-f926-4843-aec8-d7afbe309af5" (UID: "3fd3efbe-f926-4843-aec8-d7afbe309af5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:47:53.522801 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.522780    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fd3efbe-f926-4843-aec8-d7afbe309af5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fd3efbe-f926-4843-aec8-d7afbe309af5" (UID: "3fd3efbe-f926-4843-aec8-d7afbe309af5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:47:53.522899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.522809    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd3efbe-f926-4843-aec8-d7afbe309af5-kube-api-access-cd9w4" (OuterVolumeSpecName: "kube-api-access-cd9w4") pod "3fd3efbe-f926-4843-aec8-d7afbe309af5" (UID: "3fd3efbe-f926-4843-aec8-d7afbe309af5"). InnerVolumeSpecName "kube-api-access-cd9w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:47:53.621985 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.621931    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:53.621985 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.621977    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd9w4\" (UniqueName: \"kubernetes.io/projected/3fd3efbe-f926-4843-aec8-d7afbe309af5-kube-api-access-cd9w4\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:53.621985 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.621994    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fd3efbe-f926-4843-aec8-d7afbe309af5-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:53.622250 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.622007    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fd3efbe-f926-4843-aec8-d7afbe309af5-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:47:53.860620 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.860592    2577 generic.go:356] "Generic (PLEG): container finished" podID="3fd3efbe-f926-4843-aec8-d7afbe309af5" containerID="a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3" exitCode=0
Jul 21 16:47:53.861056 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.860638    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"
Jul 21 16:47:53.861056 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.860656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2" event={"ID":"3fd3efbe-f926-4843-aec8-d7afbe309af5","Type":"ContainerDied","Data":"a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3"}
Jul 21 16:47:53.861056 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.860688    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2" event={"ID":"3fd3efbe-f926-4843-aec8-d7afbe309af5","Type":"ContainerDied","Data":"77b65c4eda54a7c65ca679675e9d30a942f75622c2659a184ddc7fcd2a89d9a4"}
Jul 21 16:47:53.861056 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.860704    2577 scope.go:117] "RemoveContainer" containerID="a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3"
Jul 21 16:47:53.869066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.869045    2577 scope.go:117] "RemoveContainer" containerID="a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3"
Jul 21 16:47:53.869328 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:47:53.869305    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3\": container with ID starting with a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3 not found: ID does not exist" containerID="a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3"
Jul 21 16:47:53.869428 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.869337    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3"} err="failed to get container status \"a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3\": rpc error: code = NotFound desc = could not find container \"a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3\": container with ID starting with a4ffc5add320cd0d0fe3593f04e033868d9166ef08348659022c6db129bae2b3 not found: ID does not exist"
Jul 21 16:47:53.880311 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.880289    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"]
Jul 21 16:47:53.884708 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:53.884689    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e2b86d07-kserve-dd7ffbcc5-8svt2"]
Jul 21 16:47:54.190187 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:54.190075    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fd3efbe-f926-4843-aec8-d7afbe309af5" path="/var/lib/kubelet/pods/3fd3efbe-f926-4843-aec8-d7afbe309af5/volumes"
Jul 21 16:47:54.190586 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:47:54.190565    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ca41f9-e2db-49fe-824d-3779eb1119a6" path="/var/lib/kubelet/pods/a4ca41f9-e2db-49fe-824d-3779eb1119a6/volumes"
Jul 21 16:48:01.182453 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:48:01.182408    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:48:17.098336 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:48:17.098298    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:48:26.288276 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:48:26.288239    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:48:35.377100 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:48:35.377062    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:48:44.685817 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:48:44.685780    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:48:55.887265 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:48:55.887182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:49:07.090441 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:49:07.090402    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:49:18.087951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:49:18.087913    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:49:27.496448 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:49:27.496404    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:49:37.724636 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:49:37.724594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:49:49.897292 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:49:49.897253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:50:01.295142 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:01.291031    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:50:04.095069 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:04.095042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:50:04.096113 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:04.096090    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:50:10.597546 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:10.597509    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:50:22.590579 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:22.590538    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:50:34.292076 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:34.291975    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:50:45.987076 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:45.987039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:50:53.095490 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:50:53.095451    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:51:06.684079 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:51:06.684046    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:51:19.491066 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:51:19.491021    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:51:34.786002 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:51:34.785966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:52:07.094665 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:52:07.094585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:52:18.395900 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:52:18.395865    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:52:51.830226 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:52:51.830192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:53:04.235429 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:53:04.235388    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:53:38.980787 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:53:38.980745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:53:49.697100 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:53:49.697061    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:54:09.666231 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666192    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"]
Jul 21 16:54:09.666697 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666494    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ca41f9-e2db-49fe-824d-3779eb1119a6" containerName="main"
Jul 21 16:54:09.666697 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666507    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ca41f9-e2db-49fe-824d-3779eb1119a6" containerName="main"
Jul 21 16:54:09.666697 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666520    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fd3efbe-f926-4843-aec8-d7afbe309af5" containerName="main"
Jul 21 16:54:09.666697 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666526    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fd3efbe-f926-4843-aec8-d7afbe309af5" containerName="main"
Jul 21 16:54:09.666697 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666588    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fd3efbe-f926-4843-aec8-d7afbe309af5" containerName="main"
Jul 21 16:54:09.666697 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.666596    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ca41f9-e2db-49fe-824d-3779eb1119a6" containerName="main"
Jul 21 16:54:09.669381 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.669364    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:09.671336 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.671312    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:54:09.671336 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.671317    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 16:54:09.677468 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.677441    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"]
Jul 21 16:54:09.784951 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.784913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f523850-3fcb-49df-8ef7-c53b3cfc1992-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9f938885-fs7w9\" (UID: \"7f523850-3fcb-49df-8ef7-c53b3cfc1992\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:09.886437 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.886401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f523850-3fcb-49df-8ef7-c53b3cfc1992-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9f938885-fs7w9\" (UID: \"7f523850-3fcb-49df-8ef7-c53b3cfc1992\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:09.887069 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.887047    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f523850-3fcb-49df-8ef7-c53b3cfc1992-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9f938885-fs7w9\" (UID: \"7f523850-3fcb-49df-8ef7-c53b3cfc1992\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:09.981728 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:09.981655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:10.113042 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:10.112943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"]
Jul 21 16:54:10.115703 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:54:10.115679    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f523850_3fcb_49df_8ef7_c53b3cfc1992.slice/crio-fee10d1b3676095d0b1cd9983165b05cb75662e73778f576de8e072a7a7ed15e WatchSource:0}: Error finding container fee10d1b3676095d0b1cd9983165b05cb75662e73778f576de8e072a7a7ed15e: Status 404 returned error can't find the container with id fee10d1b3676095d0b1cd9983165b05cb75662e73778f576de8e072a7a7ed15e
Jul 21 16:54:10.117630 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:10.117615    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 16:54:10.440798 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:10.440756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9" event={"ID":"7f523850-3fcb-49df-8ef7-c53b3cfc1992","Type":"ContainerStarted","Data":"fee10d1b3676095d0b1cd9983165b05cb75662e73778f576de8e072a7a7ed15e"}
Jul 21 16:54:14.460905 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:14.460866    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f523850-3fcb-49df-8ef7-c53b3cfc1992" containerID="c7488105cc7ff0c0c54730b5e935c61a71c641baee7911e16bcfbfb887ec9392" exitCode=0
Jul 21 16:54:14.461300 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:14.460951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9" event={"ID":"7f523850-3fcb-49df-8ef7-c53b3cfc1992","Type":"ContainerDied","Data":"c7488105cc7ff0c0c54730b5e935c61a71c641baee7911e16bcfbfb887ec9392"}
Jul 21 16:54:15.592006 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:15.591979    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:15.637354 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:15.637322    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f523850-3fcb-49df-8ef7-c53b3cfc1992-maas-api-service-ca\") pod \"7f523850-3fcb-49df-8ef7-c53b3cfc1992\" (UID: \"7f523850-3fcb-49df-8ef7-c53b3cfc1992\") "
Jul 21 16:54:15.637653 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:15.637632    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f523850-3fcb-49df-8ef7-c53b3cfc1992-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f523850-3fcb-49df-8ef7-c53b3cfc1992" (UID: "7f523850-3fcb-49df-8ef7-c53b3cfc1992"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:54:15.738321 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:15.738237    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f523850-3fcb-49df-8ef7-c53b3cfc1992-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:54:16.471633 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:16.471559    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"
Jul 21 16:54:16.471779 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:16.471559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9" event={"ID":"7f523850-3fcb-49df-8ef7-c53b3cfc1992","Type":"ContainerDied","Data":"fee10d1b3676095d0b1cd9983165b05cb75662e73778f576de8e072a7a7ed15e"}
Jul 21 16:54:16.471779 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:16.471682    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fee10d1b3676095d0b1cd9983165b05cb75662e73778f576de8e072a7a7ed15e"
Jul 21 16:54:22.887368 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:22.887333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:54:24.750693 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:24.750660    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"]
Jul 21 16:54:24.755172 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:24.755144    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9f938885-fs7w9"]
Jul 21 16:54:26.189989 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:54:26.189955    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f523850-3fcb-49df-8ef7-c53b3cfc1992" path="/var/lib/kubelet/pods/7f523850-3fcb-49df-8ef7-c53b3cfc1992/volumes"
Jul 21 16:55:04.119905 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:55:04.119875    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:55:04.122343 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:55:04.122322    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 16:55:51.196616 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:55:51.196583    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:56:02.034778 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:02.034744    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:56:12.690837 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:12.690801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:56:23.192252 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.192210    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"]
Jul 21 16:56:23.192734 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.192555    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f523850-3fcb-49df-8ef7-c53b3cfc1992" containerName="revoke-keys"
Jul 21 16:56:23.192734 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.192567    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f523850-3fcb-49df-8ef7-c53b3cfc1992" containerName="revoke-keys"
Jul 21 16:56:23.192734 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.192620    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f523850-3fcb-49df-8ef7-c53b3cfc1992" containerName="revoke-keys"
Jul 21 16:56:23.195463 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.195445    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:23.197767 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.197749    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 16:56:23.197815 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.197753    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:56:23.203535 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.203508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"]
Jul 21 16:56:23.336938 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.336904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk\" (UID: \"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:23.437546 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.437502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk\" (UID: \"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:23.438162 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.438144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk\" (UID: \"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:23.506655 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.506581    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:23.632350 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:23.632279    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"]
Jul 21 16:56:23.635242 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:56:23.635214    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a9c941_10f4_42d1_ab7a_03bbc5c9c9ee.slice/crio-2bae55362d3fa2ea1957d4e27b17da73070a2f988bd3dd95781cc3f7a1a2a788 WatchSource:0}: Error finding container 2bae55362d3fa2ea1957d4e27b17da73070a2f988bd3dd95781cc3f7a1a2a788: Status 404 returned error can't find the container with id 2bae55362d3fa2ea1957d4e27b17da73070a2f988bd3dd95781cc3f7a1a2a788
Jul 21 16:56:24.019209 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:24.019176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk" event={"ID":"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee","Type":"ContainerStarted","Data":"e2a092f7ca2535f76cd84ba36490cff9f40ae34c87d0857dd6784bca3927ab65"}
Jul 21 16:56:24.019364 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:24.019227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk" event={"ID":"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee","Type":"ContainerStarted","Data":"2bae55362d3fa2ea1957d4e27b17da73070a2f988bd3dd95781cc3f7a1a2a788"}
Jul 21 16:56:24.055526 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:24.055470    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk" podStartSLOduration=1.055450448 podStartE2EDuration="1.055450448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:56:24.054321589 +0000 UTC m=+1880.395241453" watchObservedRunningTime="2026-07-21 16:56:24.055450448 +0000 UTC m=+1880.396370327"
Jul 21 16:56:25.025903 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:25.025872    2577 generic.go:356] "Generic (PLEG): container finished" podID="33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee" containerID="e2a092f7ca2535f76cd84ba36490cff9f40ae34c87d0857dd6784bca3927ab65" exitCode=0
Jul 21 16:56:25.026340 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:25.025957    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk" event={"ID":"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee","Type":"ContainerDied","Data":"e2a092f7ca2535f76cd84ba36490cff9f40ae34c87d0857dd6784bca3927ab65"}
Jul 21 16:56:26.164011 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:26.163987    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:26.264446 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:26.264416    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee-maas-api-service-ca\") pod \"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee\" (UID: \"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee\") "
Jul 21 16:56:26.264859 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:26.264829    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee" (UID: "33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:56:26.365701 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:26.365675    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:56:27.036020 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:27.035973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk" event={"ID":"33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee","Type":"ContainerDied","Data":"2bae55362d3fa2ea1957d4e27b17da73070a2f988bd3dd95781cc3f7a1a2a788"}
Jul 21 16:56:27.036020 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:27.035993    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"
Jul 21 16:56:27.036020 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:27.036026    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bae55362d3fa2ea1957d4e27b17da73070a2f988bd3dd95781cc3f7a1a2a788"
Jul 21 16:56:34.789641 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:34.789602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:56:38.276247 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:38.276213    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"]
Jul 21 16:56:38.280325 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:38.280289    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afe3d8e0-dcghk"]
Jul 21 16:56:40.192924 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:56:40.192885    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee" path="/var/lib/kubelet/pods/33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee/volumes"
Jul 21 16:57:14.308013 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:14.307973    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:57:40.596356 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.596318    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"]
Jul 21 16:57:40.596822 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.596802    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee" containerName="revoke-keys"
Jul 21 16:57:40.596822 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.596820    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee" containerName="revoke-keys"
Jul 21 16:57:40.596936 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.596911    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a9c941-10f4-42d1-ab7a-03bbc5c9c9ee" containerName="revoke-keys"
Jul 21 16:57:40.599712 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.599686    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.602256 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.602233    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e336b700\"/\"openshift-service-ca.crt\""
Jul 21 16:57:40.602377 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.602263    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-e336b700\"/\"kube-root-ca.crt\""
Jul 21 16:57:40.602818 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.602801    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e336b700\"/\"e2e-lifecycle-model-e336b700-kserve-self-signed-certs\""
Jul 21 16:57:40.603081 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.603069    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-e336b700\"/\"default-dockercfg-k2srh\""
Jul 21 16:57:40.611163 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.611139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"]
Jul 21 16:57:40.723720 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.723691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-dshm\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.723899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.723738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-model-cache\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.723899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.723768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkr9g\" (UniqueName: \"kubernetes.io/projected/1f4d02d7-962d-47c6-9156-df6d15b0c815-kube-api-access-mkr9g\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.723899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.723880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-tmp-dir\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.724010 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.723980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f4d02d7-962d-47c6-9156-df6d15b0c815-tls-certs\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.724044 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.724013    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-home\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.824701 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.824667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-model-cache\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.824899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.824712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkr9g\" (UniqueName: \"kubernetes.io/projected/1f4d02d7-962d-47c6-9156-df6d15b0c815-kube-api-access-mkr9g\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.824899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.824765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-tmp-dir\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.824899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.824832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f4d02d7-962d-47c6-9156-df6d15b0c815-tls-certs\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.824899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.824859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-home\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.824899 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.824887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-dshm\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.825219 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.825095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-model-cache\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.825219 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.825192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-home\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.825316 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.825282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-tmp-dir\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.827132 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.827095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-dshm\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.827240 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.827228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f4d02d7-962d-47c6-9156-df6d15b0c815-tls-certs\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.833193 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.833170    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkr9g\" (UniqueName: \"kubernetes.io/projected/1f4d02d7-962d-47c6-9156-df6d15b0c815-kube-api-access-mkr9g\") pod \"e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") " pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:40.909287 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:40.909218    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:41.049508 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:41.048771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"]
Jul 21 16:57:41.357344 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:41.357304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77" event={"ID":"1f4d02d7-962d-47c6-9156-df6d15b0c815","Type":"ContainerStarted","Data":"33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8"}
Jul 21 16:57:41.357344 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:41.357348    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77" event={"ID":"1f4d02d7-962d-47c6-9156-df6d15b0c815","Type":"ContainerStarted","Data":"d66d9bdfc0bbdb9be5dbf8b23cb5b5eabf648dcd0d70c29dad79254a274b2c91"}
Jul 21 16:57:41.385989 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:41.385936    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77" podStartSLOduration=1.385920303 podStartE2EDuration="1.385920303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:57:41.384773735 +0000 UTC m=+1957.725693621" watchObservedRunningTime="2026-07-21 16:57:41.385920303 +0000 UTC m=+1957.726840165"
Jul 21 16:57:43.791064 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:43.791028    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:57:50.910335 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:50.910299    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:50.910846 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:50.910357    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:50.923272 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:50.923245    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:57:51.413224 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:57:51.413197    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:58:01.602006 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:01.601921    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:58:07.919021 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:07.918983    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"]
Jul 21 16:58:07.922088 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:07.922072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:07.925168 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:07.925141    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 16:58:07.925303 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:07.925221    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 16:58:07.936954 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:07.936929    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"]
Jul 21 16:58:07.957933 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:07.957910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c1280-ccf6-4611-9e4f-f42f6b912bc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e336b700-86bx5\" (UID: \"d30c1280-ccf6-4611-9e4f-f42f6b912bc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:08.058686 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:08.058646    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c1280-ccf6-4611-9e4f-f42f6b912bc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e336b700-86bx5\" (UID: \"d30c1280-ccf6-4611-9e4f-f42f6b912bc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:08.059324 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:08.059301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c1280-ccf6-4611-9e4f-f42f6b912bc1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e336b700-86bx5\" (UID: \"d30c1280-ccf6-4611-9e4f-f42f6b912bc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:08.232397 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:08.232308    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:08.379900 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:08.379812    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"]
Jul 21 16:58:08.382711 ip-10-0-142-11 kubenswrapper[2577]: W0721 16:58:08.382678    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd30c1280_ccf6_4611_9e4f_f42f6b912bc1.slice/crio-6e1e5dc567f4c2199139d2eaafaefa80c08c8b93afca1dc2beee0a284ffa8c57 WatchSource:0}: Error finding container 6e1e5dc567f4c2199139d2eaafaefa80c08c8b93afca1dc2beee0a284ffa8c57: Status 404 returned error can't find the container with id 6e1e5dc567f4c2199139d2eaafaefa80c08c8b93afca1dc2beee0a284ffa8c57
Jul 21 16:58:08.481541 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:08.481508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5" event={"ID":"d30c1280-ccf6-4611-9e4f-f42f6b912bc1","Type":"ContainerStarted","Data":"6e1e5dc567f4c2199139d2eaafaefa80c08c8b93afca1dc2beee0a284ffa8c57"}
Jul 21 16:58:09.486775 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:09.486741    2577 generic.go:356] "Generic (PLEG): container finished" podID="d30c1280-ccf6-4611-9e4f-f42f6b912bc1" containerID="0670673ca60e74eae1cadb61b508207a7ab44eedd0f49660844f5babea9244a1" exitCode=0
Jul 21 16:58:09.487242 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:09.486822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5" event={"ID":"d30c1280-ccf6-4611-9e4f-f42f6b912bc1","Type":"ContainerDied","Data":"0670673ca60e74eae1cadb61b508207a7ab44eedd0f49660844f5babea9244a1"}
Jul 21 16:58:10.618622 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:10.618597    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:10.679777 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:10.679746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c1280-ccf6-4611-9e4f-f42f6b912bc1-maas-api-service-ca\") pod \"d30c1280-ccf6-4611-9e4f-f42f6b912bc1\" (UID: \"d30c1280-ccf6-4611-9e4f-f42f6b912bc1\") "
Jul 21 16:58:10.680081 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:10.680060    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d30c1280-ccf6-4611-9e4f-f42f6b912bc1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d30c1280-ccf6-4611-9e4f-f42f6b912bc1" (UID: "d30c1280-ccf6-4611-9e4f-f42f6b912bc1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 16:58:10.780822 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:10.780741    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d30c1280-ccf6-4611-9e4f-f42f6b912bc1-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:11.495995 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:11.495963    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"
Jul 21 16:58:11.496201 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:11.495994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5" event={"ID":"d30c1280-ccf6-4611-9e4f-f42f6b912bc1","Type":"ContainerDied","Data":"6e1e5dc567f4c2199139d2eaafaefa80c08c8b93afca1dc2beee0a284ffa8c57"}
Jul 21 16:58:11.496201 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:11.496043    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e1e5dc567f4c2199139d2eaafaefa80c08c8b93afca1dc2beee0a284ffa8c57"
Jul 21 16:58:22.005214 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:22.005178    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:58:28.018171 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:28.018133    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"]
Jul 21 16:58:28.026513 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:28.026477    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e336b700-86bx5"]
Jul 21 16:58:28.189597 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:28.189568    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d30c1280-ccf6-4611-9e4f-f42f6b912bc1" path="/var/lib/kubelet/pods/d30c1280-ccf6-4611-9e4f-f42f6b912bc1/volumes"
Jul 21 16:58:30.887916 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:30.887879    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:58:35.269698 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:35.269660    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"]
Jul 21 16:58:50.289589 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.289548    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77" podUID="1f4d02d7-962d-47c6-9156-df6d15b0c815" containerName="main" containerID="cri-o://33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8" gracePeriod=45
Jul 21 16:58:50.535208 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.535182    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:58:50.538815 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.538797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-home\") pod \"1f4d02d7-962d-47c6-9156-df6d15b0c815\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") "
Jul 21 16:58:50.538904 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.538828    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-dshm\") pod \"1f4d02d7-962d-47c6-9156-df6d15b0c815\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") "
Jul 21 16:58:50.538904 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.538865    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-model-cache\") pod \"1f4d02d7-962d-47c6-9156-df6d15b0c815\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") "
Jul 21 16:58:50.538904 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.538882    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f4d02d7-962d-47c6-9156-df6d15b0c815-tls-certs\") pod \"1f4d02d7-962d-47c6-9156-df6d15b0c815\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") "
Jul 21 16:58:50.539041 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.538921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkr9g\" (UniqueName: \"kubernetes.io/projected/1f4d02d7-962d-47c6-9156-df6d15b0c815-kube-api-access-mkr9g\") pod \"1f4d02d7-962d-47c6-9156-df6d15b0c815\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") "
Jul 21 16:58:50.539041 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.538937    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-tmp-dir\") pod \"1f4d02d7-962d-47c6-9156-df6d15b0c815\" (UID: \"1f4d02d7-962d-47c6-9156-df6d15b0c815\") "
Jul 21 16:58:50.539115 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.539078    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-home" (OuterVolumeSpecName: "home") pod "1f4d02d7-962d-47c6-9156-df6d15b0c815" (UID: "1f4d02d7-962d-47c6-9156-df6d15b0c815"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:50.539254 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.539231    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:50.539371 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.539279    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-model-cache" (OuterVolumeSpecName: "model-cache") pod "1f4d02d7-962d-47c6-9156-df6d15b0c815" (UID: "1f4d02d7-962d-47c6-9156-df6d15b0c815"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:50.539450 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.539424    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1f4d02d7-962d-47c6-9156-df6d15b0c815" (UID: "1f4d02d7-962d-47c6-9156-df6d15b0c815"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:50.541210 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.541159    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f4d02d7-962d-47c6-9156-df6d15b0c815-kube-api-access-mkr9g" (OuterVolumeSpecName: "kube-api-access-mkr9g") pod "1f4d02d7-962d-47c6-9156-df6d15b0c815" (UID: "1f4d02d7-962d-47c6-9156-df6d15b0c815"). InnerVolumeSpecName "kube-api-access-mkr9g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 16:58:50.541362 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.541337    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f4d02d7-962d-47c6-9156-df6d15b0c815-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1f4d02d7-962d-47c6-9156-df6d15b0c815" (UID: "1f4d02d7-962d-47c6-9156-df6d15b0c815"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 16:58:50.541362 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.541345    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-dshm" (OuterVolumeSpecName: "dshm") pod "1f4d02d7-962d-47c6-9156-df6d15b0c815" (UID: "1f4d02d7-962d-47c6-9156-df6d15b0c815"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 16:58:50.640505 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.640469    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkr9g\" (UniqueName: \"kubernetes.io/projected/1f4d02d7-962d-47c6-9156-df6d15b0c815-kube-api-access-mkr9g\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:50.640505 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.640497    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:50.640505 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.640506    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:50.640777 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.640515    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1f4d02d7-962d-47c6-9156-df6d15b0c815-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:50.640777 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.640524    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1f4d02d7-962d-47c6-9156-df6d15b0c815-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 16:58:50.659566 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.659537    2577 generic.go:356] "Generic (PLEG): container finished" podID="1f4d02d7-962d-47c6-9156-df6d15b0c815" containerID="33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8" exitCode=0
Jul 21 16:58:50.659685 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.659580    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"
Jul 21 16:58:50.659685 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.659630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77" event={"ID":"1f4d02d7-962d-47c6-9156-df6d15b0c815","Type":"ContainerDied","Data":"33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8"}
Jul 21 16:58:50.659685 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.659672    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77" event={"ID":"1f4d02d7-962d-47c6-9156-df6d15b0c815","Type":"ContainerDied","Data":"d66d9bdfc0bbdb9be5dbf8b23cb5b5eabf648dcd0d70c29dad79254a274b2c91"}
Jul 21 16:58:50.659789 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.659695    2577 scope.go:117] "RemoveContainer" containerID="33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8"
Jul 21 16:58:50.668270 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.668247    2577 scope.go:117] "RemoveContainer" containerID="33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8"
Jul 21 16:58:50.668513 ip-10-0-142-11 kubenswrapper[2577]: E0721 16:58:50.668493    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8\": container with ID starting with 33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8 not found: ID does not exist" containerID="33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8"
Jul 21 16:58:50.668570 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.668521    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8"} err="failed to get container status \"33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8\": rpc error: code = NotFound desc = could not find container \"33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8\": container with ID starting with 33076f37a4f208a0a2dcde0c4464e288835d8223f5214dd44d6b3c4c9276c9a8 not found: ID does not exist"
Jul 21 16:58:50.683094 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.683069    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"]
Jul 21 16:58:50.687041 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:50.687021    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-e336b700/e2e-lifecycle-model-e336b700-kserve-d698f756c-rkg77"]
Jul 21 16:58:52.190062 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:58:52.190027    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f4d02d7-962d-47c6-9156-df6d15b0c815" path="/var/lib/kubelet/pods/1f4d02d7-962d-47c6-9156-df6d15b0c815/volumes"
Jul 21 16:59:23.705915 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:59:23.705879    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 16:59:34.849745 ip-10-0-142-11 kubenswrapper[2577]: I0721 16:59:34.849656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:00:04.145407 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:04.145375    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 17:00:04.148149 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:04.148113    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 17:00:27.893134 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:27.893078    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:00:40.314686 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:40.314650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:00:44.822971 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.822933    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"]
Jul 21 17:00:44.823442 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.823422    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d30c1280-ccf6-4611-9e4f-f42f6b912bc1" containerName="revoke-keys"
Jul 21 17:00:44.823509 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.823442    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d30c1280-ccf6-4611-9e4f-f42f6b912bc1" containerName="revoke-keys"
Jul 21 17:00:44.823509 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.823478    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f4d02d7-962d-47c6-9156-df6d15b0c815" containerName="main"
Jul 21 17:00:44.823509 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.823488    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f4d02d7-962d-47c6-9156-df6d15b0c815" containerName="main"
Jul 21 17:00:44.823650 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.823565    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d30c1280-ccf6-4611-9e4f-f42f6b912bc1" containerName="revoke-keys"
Jul 21 17:00:44.823650 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.823581    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f4d02d7-962d-47c6-9156-df6d15b0c815" containerName="main"
Jul 21 17:00:44.826716 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.826697    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:44.829494 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.829474    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4a9a8c\"/\"kube-root-ca.crt\""
Jul 21 17:00:44.829614 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.829552    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4a9a8c\"/\"default-dockercfg-qrxpk\""
Jul 21 17:00:44.830210 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.830191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4a9a8c\"/\"test-model-4a9a8c-kserve-self-signed-certs\""
Jul 21 17:00:44.830303 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.830232    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4a9a8c\"/\"openshift-service-ca.crt\""
Jul 21 17:00:44.837180 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.837161    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"]
Jul 21 17:00:44.922742 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.922709    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-tmp-dir\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:44.922922 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.922758    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-dshm\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:44.922922 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.922786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949e3053-5ba1-4d51-9a1f-7754a673d727-tls-certs\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:44.922922 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.922837    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-home\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:44.922922 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.922873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-model-cache\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:44.922922 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:44.922910    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6l89\" (UniqueName: \"kubernetes.io/projected/949e3053-5ba1-4d51-9a1f-7754a673d727-kube-api-access-l6l89\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.023673 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.023643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-dshm\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.023851 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.023690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949e3053-5ba1-4d51-9a1f-7754a673d727-tls-certs\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.023851 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.023708    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-home\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.023851 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.023730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-model-cache\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.023851 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.023765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6l89\" (UniqueName: \"kubernetes.io/projected/949e3053-5ba1-4d51-9a1f-7754a673d727-kube-api-access-l6l89\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.023851 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.023822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-tmp-dir\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.024240 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.024188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-model-cache\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.024370 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.024249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-home\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.024370 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.024284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-tmp-dir\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.026071 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.026042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-dshm\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.026442 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.026417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949e3053-5ba1-4d51-9a1f-7754a673d727-tls-certs\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.033463 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.033440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6l89\" (UniqueName: \"kubernetes.io/projected/949e3053-5ba1-4d51-9a1f-7754a673d727-kube-api-access-l6l89\") pod \"test-model-4a9a8c-kserve-6d49668d65-lqkts\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") " pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.135495 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.135462    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:45.282142 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:45.282047    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"]
Jul 21 17:00:45.284949 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:00:45.284923    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod949e3053_5ba1_4d51_9a1f_7754a673d727.slice/crio-3190e916f66f2c0fb2ea86ca33508807a0ef1ce41692eedfc15fe5014b7568ce WatchSource:0}: Error finding container 3190e916f66f2c0fb2ea86ca33508807a0ef1ce41692eedfc15fe5014b7568ce: Status 404 returned error can't find the container with id 3190e916f66f2c0fb2ea86ca33508807a0ef1ce41692eedfc15fe5014b7568ce
Jul 21 17:00:46.162257 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:46.162213    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts" event={"ID":"949e3053-5ba1-4d51-9a1f-7754a673d727","Type":"ContainerStarted","Data":"9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6"}
Jul 21 17:00:46.162650 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:46.162266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts" event={"ID":"949e3053-5ba1-4d51-9a1f-7754a673d727","Type":"ContainerStarted","Data":"3190e916f66f2c0fb2ea86ca33508807a0ef1ce41692eedfc15fe5014b7568ce"}
Jul 21 17:00:49.591814 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:49.591760    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts" podStartSLOduration=5.591744058 podStartE2EDuration="5.591744058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:00:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:00:46.18765008 +0000 UTC m=+2142.528569944" watchObservedRunningTime="2026-07-21 17:00:49.591744058 +0000 UTC m=+2145.932663920"
Jul 21 17:00:49.593051 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:49.593029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:00:55.136057 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:55.136018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:55.136057 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:55.136064    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:55.154727 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:55.154695    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:00:55.212086 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:00:55.212060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:01:04.215437 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:04.215355    2577 scope.go:117] "RemoveContainer" containerID="c7488105cc7ff0c0c54730b5e935c61a71c641baee7911e16bcfbfb887ec9392"
Jul 21 17:01:10.291108 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.291071    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"]
Jul 21 17:01:10.294517 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.294500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.296776 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.296755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1a8da1\"/\"default-dockercfg-vr2jm\""
Jul 21 17:01:10.297423 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.297399    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1a8da1\"/\"test-model-1a8da1-kserve-self-signed-certs\""
Jul 21 17:01:10.297516 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.297421    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1a8da1\"/\"openshift-service-ca.crt\""
Jul 21 17:01:10.297516 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.297471    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1a8da1\"/\"kube-root-ca.crt\""
Jul 21 17:01:10.303178 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.303152    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"]
Jul 21 17:01:10.457993 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.457954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-model-cache\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.457993 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.457994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-tmp-dir\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.458267 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.458028    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d726ed15-fd34-4df3-9576-f57bf0355f23-tls-certs\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.458267 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.458101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-dshm\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.458267 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.458162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-home\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.458267 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.458210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n57f9\" (UniqueName: \"kubernetes.io/projected/d726ed15-fd34-4df3-9576-f57bf0355f23-kube-api-access-n57f9\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.558977 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.558885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-model-cache\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.558977 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.558923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-tmp-dir\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.558977 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.558949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d726ed15-fd34-4df3-9576-f57bf0355f23-tls-certs\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.559294 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.559000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-dshm\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.559294 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.559030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-home\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.559294 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.559050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n57f9\" (UniqueName: \"kubernetes.io/projected/d726ed15-fd34-4df3-9576-f57bf0355f23-kube-api-access-n57f9\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.559451 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.559320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-tmp-dir\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.559451 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.559371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-model-cache\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.559451 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.559387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-home\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.561397 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.561365    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-dshm\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.561589 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.561573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d726ed15-fd34-4df3-9576-f57bf0355f23-tls-certs\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.570578 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.570555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n57f9\" (UniqueName: \"kubernetes.io/projected/d726ed15-fd34-4df3-9576-f57bf0355f23-kube-api-access-n57f9\") pod \"test-model-1a8da1-kserve-5496c97dc7-jkp9c\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") " pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.604562 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.604536    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:10.751074 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:10.751049    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"]
Jul 21 17:01:10.753295 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:01:10.753265    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd726ed15_fd34_4df3_9576_f57bf0355f23.slice/crio-d0afdd39b57779a1f4cc4025ef9b2083dec38988e362341c3b799a9480d22c0a WatchSource:0}: Error finding container d0afdd39b57779a1f4cc4025ef9b2083dec38988e362341c3b799a9480d22c0a: Status 404 returned error can't find the container with id d0afdd39b57779a1f4cc4025ef9b2083dec38988e362341c3b799a9480d22c0a
Jul 21 17:01:11.270639 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:11.270597    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c" event={"ID":"d726ed15-fd34-4df3-9576-f57bf0355f23","Type":"ContainerStarted","Data":"1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19"}
Jul 21 17:01:11.270836 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:11.270652    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c" event={"ID":"d726ed15-fd34-4df3-9576-f57bf0355f23","Type":"ContainerStarted","Data":"d0afdd39b57779a1f4cc4025ef9b2083dec38988e362341c3b799a9480d22c0a"}
Jul 21 17:01:11.288909 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:11.288854    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c" podStartSLOduration=1.288838941 podStartE2EDuration="1.288838941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:01:11.288250169 +0000 UTC m=+2167.629170065" watchObservedRunningTime="2026-07-21 17:01:11.288838941 +0000 UTC m=+2167.629758804"
Jul 21 17:01:15.712622 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:15.712585    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:01:20.604779 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:20.604739    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:20.605188 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:20.604799    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:20.617016 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:20.616987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:21.325039 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:21.325001    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:01:49.510873 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:49.510836    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"]
Jul 21 17:01:50.462067 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:50.462035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"]
Jul 21 17:01:53.304180 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:01:53.304136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:02:04.530764 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.530721    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts" podUID="949e3053-5ba1-4d51-9a1f-7754a673d727" containerName="main" containerID="cri-o://9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6" gracePeriod=45
Jul 21 17:02:04.777498 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.777475    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:02:04.939753 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.939716    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949e3053-5ba1-4d51-9a1f-7754a673d727-tls-certs\") pod \"949e3053-5ba1-4d51-9a1f-7754a673d727\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") "
Jul 21 17:02:04.939925 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.939768    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-home\") pod \"949e3053-5ba1-4d51-9a1f-7754a673d727\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") "
Jul 21 17:02:04.939925 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.939799    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-tmp-dir\") pod \"949e3053-5ba1-4d51-9a1f-7754a673d727\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") "
Jul 21 17:02:04.939925 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.939854    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6l89\" (UniqueName: \"kubernetes.io/projected/949e3053-5ba1-4d51-9a1f-7754a673d727-kube-api-access-l6l89\") pod \"949e3053-5ba1-4d51-9a1f-7754a673d727\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") "
Jul 21 17:02:04.939925 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.939890    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-model-cache\") pod \"949e3053-5ba1-4d51-9a1f-7754a673d727\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") "
Jul 21 17:02:04.940107 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.939924    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-dshm\") pod \"949e3053-5ba1-4d51-9a1f-7754a673d727\" (UID: \"949e3053-5ba1-4d51-9a1f-7754a673d727\") "
Jul 21 17:02:04.940107 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.940087    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "949e3053-5ba1-4d51-9a1f-7754a673d727" (UID: "949e3053-5ba1-4d51-9a1f-7754a673d727"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:04.940243 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.940103    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-home" (OuterVolumeSpecName: "home") pod "949e3053-5ba1-4d51-9a1f-7754a673d727" (UID: "949e3053-5ba1-4d51-9a1f-7754a673d727"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:04.940243 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.940186    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-model-cache" (OuterVolumeSpecName: "model-cache") pod "949e3053-5ba1-4d51-9a1f-7754a673d727" (UID: "949e3053-5ba1-4d51-9a1f-7754a673d727"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:04.940243 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.940228    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:04.942100 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.942069    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-dshm" (OuterVolumeSpecName: "dshm") pod "949e3053-5ba1-4d51-9a1f-7754a673d727" (UID: "949e3053-5ba1-4d51-9a1f-7754a673d727"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:04.942100 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.942092    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/949e3053-5ba1-4d51-9a1f-7754a673d727-kube-api-access-l6l89" (OuterVolumeSpecName: "kube-api-access-l6l89") pod "949e3053-5ba1-4d51-9a1f-7754a673d727" (UID: "949e3053-5ba1-4d51-9a1f-7754a673d727"). InnerVolumeSpecName "kube-api-access-l6l89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:04.942271 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:04.942151    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/949e3053-5ba1-4d51-9a1f-7754a673d727-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "949e3053-5ba1-4d51-9a1f-7754a673d727" (UID: "949e3053-5ba1-4d51-9a1f-7754a673d727"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:02:05.041517 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.041487    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6l89\" (UniqueName: \"kubernetes.io/projected/949e3053-5ba1-4d51-9a1f-7754a673d727-kube-api-access-l6l89\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.041517 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.041518    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.041704 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.041529    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.041704 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.041537    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/949e3053-5ba1-4d51-9a1f-7754a673d727-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.041704 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.041545    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/949e3053-5ba1-4d51-9a1f-7754a673d727-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.482849 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.482809    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c" podUID="d726ed15-fd34-4df3-9576-f57bf0355f23" containerName="main" containerID="cri-o://1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19" gracePeriod=45
Jul 21 17:02:05.501676 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.501646    2577 generic.go:356] "Generic (PLEG): container finished" podID="949e3053-5ba1-4d51-9a1f-7754a673d727" containerID="9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6" exitCode=0
Jul 21 17:02:05.501775 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.501690    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"
Jul 21 17:02:05.501775 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.501726    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts" event={"ID":"949e3053-5ba1-4d51-9a1f-7754a673d727","Type":"ContainerDied","Data":"9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6"}
Jul 21 17:02:05.501846 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.501780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts" event={"ID":"949e3053-5ba1-4d51-9a1f-7754a673d727","Type":"ContainerDied","Data":"3190e916f66f2c0fb2ea86ca33508807a0ef1ce41692eedfc15fe5014b7568ce"}
Jul 21 17:02:05.501846 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.501798    2577 scope.go:117] "RemoveContainer" containerID="9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6"
Jul 21 17:02:05.543144 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.543094    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"]
Jul 21 17:02:05.550566 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.550536    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4a9a8c/test-model-4a9a8c-kserve-6d49668d65-lqkts"]
Jul 21 17:02:05.593572 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.593395    2577 scope.go:117] "RemoveContainer" containerID="9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6"
Jul 21 17:02:05.593768 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:02:05.593747    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6\": container with ID starting with 9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6 not found: ID does not exist" containerID="9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6"
Jul 21 17:02:05.593836 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.593778    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6"} err="failed to get container status \"9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6\": rpc error: code = NotFound desc = could not find container \"9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6\": container with ID starting with 9b7cc6557189dce59b81845468aaa5903d89328a4dd79de3fa9c19920dcf02e6 not found: ID does not exist"
Jul 21 17:02:05.695283 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.695254    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:02:05.733539 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.733489    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:02:05.849181 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849141    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n57f9\" (UniqueName: \"kubernetes.io/projected/d726ed15-fd34-4df3-9576-f57bf0355f23-kube-api-access-n57f9\") pod \"d726ed15-fd34-4df3-9576-f57bf0355f23\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") "
Jul 21 17:02:05.849365 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849250    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-tmp-dir\") pod \"d726ed15-fd34-4df3-9576-f57bf0355f23\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") "
Jul 21 17:02:05.849365 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-dshm\") pod \"d726ed15-fd34-4df3-9576-f57bf0355f23\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") "
Jul 21 17:02:05.849504 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849402    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-model-cache\") pod \"d726ed15-fd34-4df3-9576-f57bf0355f23\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") "
Jul 21 17:02:05.849504 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849442    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-home\") pod \"d726ed15-fd34-4df3-9576-f57bf0355f23\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") "
Jul 21 17:02:05.849504 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849465    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d726ed15-fd34-4df3-9576-f57bf0355f23-tls-certs\") pod \"d726ed15-fd34-4df3-9576-f57bf0355f23\" (UID: \"d726ed15-fd34-4df3-9576-f57bf0355f23\") "
Jul 21 17:02:05.849638 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849506    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d726ed15-fd34-4df3-9576-f57bf0355f23" (UID: "d726ed15-fd34-4df3-9576-f57bf0355f23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:05.849742 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849707    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-model-cache" (OuterVolumeSpecName: "model-cache") pod "d726ed15-fd34-4df3-9576-f57bf0355f23" (UID: "d726ed15-fd34-4df3-9576-f57bf0355f23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:05.849742 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849718    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-home" (OuterVolumeSpecName: "home") pod "d726ed15-fd34-4df3-9576-f57bf0355f23" (UID: "d726ed15-fd34-4df3-9576-f57bf0355f23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:05.849950 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849919    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.849950 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849945    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.850079 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.849961    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.851469 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.851445    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d726ed15-fd34-4df3-9576-f57bf0355f23-kube-api-access-n57f9" (OuterVolumeSpecName: "kube-api-access-n57f9") pod "d726ed15-fd34-4df3-9576-f57bf0355f23" (UID: "d726ed15-fd34-4df3-9576-f57bf0355f23"). InnerVolumeSpecName "kube-api-access-n57f9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:02:05.851634 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.851609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-dshm" (OuterVolumeSpecName: "dshm") pod "d726ed15-fd34-4df3-9576-f57bf0355f23" (UID: "d726ed15-fd34-4df3-9576-f57bf0355f23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:02:05.851737 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.851680    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d726ed15-fd34-4df3-9576-f57bf0355f23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d726ed15-fd34-4df3-9576-f57bf0355f23" (UID: "d726ed15-fd34-4df3-9576-f57bf0355f23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:02:05.950863 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.950826    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d726ed15-fd34-4df3-9576-f57bf0355f23-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.950863 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.950858    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n57f9\" (UniqueName: \"kubernetes.io/projected/d726ed15-fd34-4df3-9576-f57bf0355f23-kube-api-access-n57f9\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:05.950863 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:05.950867    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d726ed15-fd34-4df3-9576-f57bf0355f23-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:06.190023 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.189989    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="949e3053-5ba1-4d51-9a1f-7754a673d727" path="/var/lib/kubelet/pods/949e3053-5ba1-4d51-9a1f-7754a673d727/volumes"
Jul 21 17:02:06.507676 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.507586    2577 generic.go:356] "Generic (PLEG): container finished" podID="d726ed15-fd34-4df3-9576-f57bf0355f23" containerID="1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19" exitCode=0
Jul 21 17:02:06.507676 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.507627    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"
Jul 21 17:02:06.507676 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.507645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c" event={"ID":"d726ed15-fd34-4df3-9576-f57bf0355f23","Type":"ContainerDied","Data":"1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19"}
Jul 21 17:02:06.507676 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.507675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c" event={"ID":"d726ed15-fd34-4df3-9576-f57bf0355f23","Type":"ContainerDied","Data":"d0afdd39b57779a1f4cc4025ef9b2083dec38988e362341c3b799a9480d22c0a"}
Jul 21 17:02:06.507973 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.507693    2577 scope.go:117] "RemoveContainer" containerID="1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19"
Jul 21 17:02:06.515688 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.515645    2577 scope.go:117] "RemoveContainer" containerID="1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19"
Jul 21 17:02:06.515918 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:02:06.515895    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19\": container with ID starting with 1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19 not found: ID does not exist" containerID="1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19"
Jul 21 17:02:06.516019 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.515921    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19"} err="failed to get container status \"1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19\": rpc error: code = NotFound desc = could not find container \"1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19\": container with ID starting with 1d520bdf13666fadb053427bdb640e41c69543a87576006007675e0f8ff6bd19 not found: ID does not exist"
Jul 21 17:02:06.524933 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.524912    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"]
Jul 21 17:02:06.530752 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:06.530735    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1a8da1/test-model-1a8da1-kserve-5496c97dc7-jkp9c"]
Jul 21 17:02:08.190543 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:08.190511    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d726ed15-fd34-4df3-9576-f57bf0355f23" path="/var/lib/kubelet/pods/d726ed15-fd34-4df3-9576-f57bf0355f23/volumes"
Jul 21 17:02:13.241528 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241491    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"]
Jul 21 17:02:13.241892 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241830    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d726ed15-fd34-4df3-9576-f57bf0355f23" containerName="main"
Jul 21 17:02:13.241892 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241842    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d726ed15-fd34-4df3-9576-f57bf0355f23" containerName="main"
Jul 21 17:02:13.241892 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241864    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="949e3053-5ba1-4d51-9a1f-7754a673d727" containerName="main"
Jul 21 17:02:13.241892 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241870    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="949e3053-5ba1-4d51-9a1f-7754a673d727" containerName="main"
Jul 21 17:02:13.242037 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241913    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="949e3053-5ba1-4d51-9a1f-7754a673d727" containerName="main"
Jul 21 17:02:13.242037 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.241923    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d726ed15-fd34-4df3-9576-f57bf0355f23" containerName="main"
Jul 21 17:02:13.245605 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.245578    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:13.248660 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.248618    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 17:02:13.248929 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.248891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:02:13.253391 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.253366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"]
Jul 21 17:02:13.417996 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.417960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa901f8-5024-452b-a7ea-ad5625c992a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf\" (UID: \"afa901f8-5024-452b-a7ea-ad5625c992a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:13.519389 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.519309    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa901f8-5024-452b-a7ea-ad5625c992a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf\" (UID: \"afa901f8-5024-452b-a7ea-ad5625c992a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:13.519908 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.519888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa901f8-5024-452b-a7ea-ad5625c992a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf\" (UID: \"afa901f8-5024-452b-a7ea-ad5625c992a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:13.559730 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.559701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:13.686748 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:13.686708    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"]
Jul 21 17:02:13.690264 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:02:13.690238    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa901f8_5024_452b_a7ea_ad5625c992a4.slice/crio-a8e22acfe83cd9f2a27c4567edd26969f20bbc5b3422cdb7cec4b00082f0f372 WatchSource:0}: Error finding container a8e22acfe83cd9f2a27c4567edd26969f20bbc5b3422cdb7cec4b00082f0f372: Status 404 returned error can't find the container with id a8e22acfe83cd9f2a27c4567edd26969f20bbc5b3422cdb7cec4b00082f0f372
Jul 21 17:02:14.544530 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:14.544494    2577 generic.go:356] "Generic (PLEG): container finished" podID="afa901f8-5024-452b-a7ea-ad5625c992a4" containerID="05a3720f2073321cdebb3bf44081e0cbcec772854bdf203db5cd1653e1552d6f" exitCode=0
Jul 21 17:02:14.544904 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:14.544579    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf" event={"ID":"afa901f8-5024-452b-a7ea-ad5625c992a4","Type":"ContainerDied","Data":"05a3720f2073321cdebb3bf44081e0cbcec772854bdf203db5cd1653e1552d6f"}
Jul 21 17:02:14.544904 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:14.544635    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf" event={"ID":"afa901f8-5024-452b-a7ea-ad5625c992a4","Type":"ContainerStarted","Data":"a8e22acfe83cd9f2a27c4567edd26969f20bbc5b3422cdb7cec4b00082f0f372"}
Jul 21 17:02:15.676669 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:15.676637    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:15.737918 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:15.737888    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa901f8-5024-452b-a7ea-ad5625c992a4-maas-api-service-ca\") pod \"afa901f8-5024-452b-a7ea-ad5625c992a4\" (UID: \"afa901f8-5024-452b-a7ea-ad5625c992a4\") "
Jul 21 17:02:15.738294 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:15.738272    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afa901f8-5024-452b-a7ea-ad5625c992a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "afa901f8-5024-452b-a7ea-ad5625c992a4" (UID: "afa901f8-5024-452b-a7ea-ad5625c992a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:02:15.838620 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:15.838594    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/afa901f8-5024-452b-a7ea-ad5625c992a4-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:02:16.555146 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:16.555049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf" event={"ID":"afa901f8-5024-452b-a7ea-ad5625c992a4","Type":"ContainerDied","Data":"a8e22acfe83cd9f2a27c4567edd26969f20bbc5b3422cdb7cec4b00082f0f372"}
Jul 21 17:02:16.555146 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:16.555100    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8e22acfe83cd9f2a27c4567edd26969f20bbc5b3422cdb7cec4b00082f0f372"
Jul 21 17:02:16.555146 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:16.555061    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"
Jul 21 17:02:26.882885 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:26.882808    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:02:28.322149 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:28.322100    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"]
Jul 21 17:02:28.324867 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:28.324841    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1a8da1-9xvzf"]
Jul 21 17:02:30.190473 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:30.190436    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afa901f8-5024-452b-a7ea-ad5625c992a4" path="/var/lib/kubelet/pods/afa901f8-5024-452b-a7ea-ad5625c992a4/volumes"
Jul 21 17:02:45.390189 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:45.390150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:02:59.122194 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.122158    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"]
Jul 21 17:02:59.122621 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.122470    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afa901f8-5024-452b-a7ea-ad5625c992a4" containerName="revoke-keys"
Jul 21 17:02:59.122621 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.122481    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="afa901f8-5024-452b-a7ea-ad5625c992a4" containerName="revoke-keys"
Jul 21 17:02:59.122621 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.122552    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="afa901f8-5024-452b-a7ea-ad5625c992a4" containerName="revoke-keys"
Jul 21 17:02:59.125548 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.125530    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:02:59.127887 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.127860    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 17:02:59.128023 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.127953    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:02:59.133819 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.133799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"]
Jul 21 17:02:59.324295 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.324255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da10e00e-b53b-4bee-a06e-0787b97736d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-44c780-pn2cw\" (UID: \"da10e00e-b53b-4bee-a06e-0787b97736d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:02:59.425209 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.425102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da10e00e-b53b-4bee-a06e-0787b97736d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-44c780-pn2cw\" (UID: \"da10e00e-b53b-4bee-a06e-0787b97736d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:02:59.425697 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.425677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da10e00e-b53b-4bee-a06e-0787b97736d2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-44c780-pn2cw\" (UID: \"da10e00e-b53b-4bee-a06e-0787b97736d2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:02:59.436090 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.436068    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:02:59.574805 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.574781    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"]
Jul 21 17:02:59.577351 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:02:59.577325    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda10e00e_b53b_4bee_a06e_0787b97736d2.slice/crio-4f6ac15bab2a4ddab57bb41e23f7822ef8e844d1c21efc6c3a10c28f735e5c10 WatchSource:0}: Error finding container 4f6ac15bab2a4ddab57bb41e23f7822ef8e844d1c21efc6c3a10c28f735e5c10: Status 404 returned error can't find the container with id 4f6ac15bab2a4ddab57bb41e23f7822ef8e844d1c21efc6c3a10c28f735e5c10
Jul 21 17:02:59.742558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:02:59.742471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw" event={"ID":"da10e00e-b53b-4bee-a06e-0787b97736d2","Type":"ContainerStarted","Data":"4f6ac15bab2a4ddab57bb41e23f7822ef8e844d1c21efc6c3a10c28f735e5c10"}
Jul 21 17:03:00.748595 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:00.748561    2577 generic.go:356] "Generic (PLEG): container finished" podID="da10e00e-b53b-4bee-a06e-0787b97736d2" containerID="c584eb951c7a03de490fe0b1300981e0d55b9803b4fdfedf4d55edb6ba96c004" exitCode=0
Jul 21 17:03:00.748999 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:00.748609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw" event={"ID":"da10e00e-b53b-4bee-a06e-0787b97736d2","Type":"ContainerDied","Data":"c584eb951c7a03de490fe0b1300981e0d55b9803b4fdfedf4d55edb6ba96c004"}
Jul 21 17:03:01.707000 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:01.706966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:03:01.881514 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:01.881486    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:03:01.944136 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:01.944094    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da10e00e-b53b-4bee-a06e-0787b97736d2-maas-api-service-ca\") pod \"da10e00e-b53b-4bee-a06e-0787b97736d2\" (UID: \"da10e00e-b53b-4bee-a06e-0787b97736d2\") "
Jul 21 17:03:01.944510 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:01.944488    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da10e00e-b53b-4bee-a06e-0787b97736d2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "da10e00e-b53b-4bee-a06e-0787b97736d2" (UID: "da10e00e-b53b-4bee-a06e-0787b97736d2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:03:02.045157 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:02.045042    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/da10e00e-b53b-4bee-a06e-0787b97736d2-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:03:02.759246 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:02.759215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"
Jul 21 17:03:02.759448 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:02.759248    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw" event={"ID":"da10e00e-b53b-4bee-a06e-0787b97736d2","Type":"ContainerDied","Data":"4f6ac15bab2a4ddab57bb41e23f7822ef8e844d1c21efc6c3a10c28f735e5c10"}
Jul 21 17:03:02.759448 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:02.759299    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f6ac15bab2a4ddab57bb41e23f7822ef8e844d1c21efc6c3a10c28f735e5c10"
Jul 21 17:03:04.239578 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:04.239542    2577 scope.go:117] "RemoveContainer" containerID="e2a092f7ca2535f76cd84ba36490cff9f40ae34c87d0857dd6784bca3927ab65"
Jul 21 17:03:17.888412 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:17.888377    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:03:19.209413 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:19.209363    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"]
Jul 21 17:03:19.212822 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:19.212795    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-44c780-pn2cw"]
Jul 21 17:03:20.189718 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:20.189684    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da10e00e-b53b-4bee-a06e-0787b97736d2" path="/var/lib/kubelet/pods/da10e00e-b53b-4bee-a06e-0787b97736d2/volumes"
Jul 21 17:03:26.548520 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.548488    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"]
Jul 21 17:03:26.548896 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.548816    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da10e00e-b53b-4bee-a06e-0787b97736d2" containerName="revoke-keys"
Jul 21 17:03:26.548896 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.548828    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da10e00e-b53b-4bee-a06e-0787b97736d2" containerName="revoke-keys"
Jul 21 17:03:26.548896 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.548890    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="da10e00e-b53b-4bee-a06e-0787b97736d2" containerName="revoke-keys"
Jul 21 17:03:26.552052 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.552034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:26.556936 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.556917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 17:03:26.557384 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.557365    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:03:26.567586 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.567566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"]
Jul 21 17:03:26.662413 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.662369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095a1958-a13e-4d38-88c7-866d3425fe12-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m\" (UID: \"095a1958-a13e-4d38-88c7-866d3425fe12\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:26.763128 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.763090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095a1958-a13e-4d38-88c7-866d3425fe12-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m\" (UID: \"095a1958-a13e-4d38-88c7-866d3425fe12\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:26.763737 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.763717    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095a1958-a13e-4d38-88c7-866d3425fe12-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m\" (UID: \"095a1958-a13e-4d38-88c7-866d3425fe12\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:26.861365 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.861331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:26.989145 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:26.989104    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"]
Jul 21 17:03:26.991377 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:03:26.991338    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095a1958_a13e_4d38_88c7_866d3425fe12.slice/crio-9b944f8c6ef56db61ef35cc5273772cc76eecbae9a5479a2731f552eabb677c3 WatchSource:0}: Error finding container 9b944f8c6ef56db61ef35cc5273772cc76eecbae9a5479a2731f552eabb677c3: Status 404 returned error can't find the container with id 9b944f8c6ef56db61ef35cc5273772cc76eecbae9a5479a2731f552eabb677c3
Jul 21 17:03:27.866567 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:27.866530    2577 generic.go:356] "Generic (PLEG): container finished" podID="095a1958-a13e-4d38-88c7-866d3425fe12" containerID="e0e424e37233177b4460ad957f9b10991bc71a9d91e6a438d1785c69f3b95a47" exitCode=0
Jul 21 17:03:27.866967 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:27.866621    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m" event={"ID":"095a1958-a13e-4d38-88c7-866d3425fe12","Type":"ContainerDied","Data":"e0e424e37233177b4460ad957f9b10991bc71a9d91e6a438d1785c69f3b95a47"}
Jul 21 17:03:27.866967 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:27.866677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m" event={"ID":"095a1958-a13e-4d38-88c7-866d3425fe12","Type":"ContainerStarted","Data":"9b944f8c6ef56db61ef35cc5273772cc76eecbae9a5479a2731f552eabb677c3"}
Jul 21 17:03:28.994997 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:28.994974    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:29.082397 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:29.082356    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095a1958-a13e-4d38-88c7-866d3425fe12-maas-api-service-ca\") pod \"095a1958-a13e-4d38-88c7-866d3425fe12\" (UID: \"095a1958-a13e-4d38-88c7-866d3425fe12\") "
Jul 21 17:03:29.082733 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:29.082708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/095a1958-a13e-4d38-88c7-866d3425fe12-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "095a1958-a13e-4d38-88c7-866d3425fe12" (UID: "095a1958-a13e-4d38-88c7-866d3425fe12"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:03:29.183553 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:29.183470    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/095a1958-a13e-4d38-88c7-866d3425fe12-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:03:29.876261 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:29.876231    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"
Jul 21 17:03:29.876429 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:29.876251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m" event={"ID":"095a1958-a13e-4d38-88c7-866d3425fe12","Type":"ContainerDied","Data":"9b944f8c6ef56db61ef35cc5273772cc76eecbae9a5479a2731f552eabb677c3"}
Jul 21 17:03:29.876429 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:29.876311    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b944f8c6ef56db61ef35cc5273772cc76eecbae9a5479a2731f552eabb677c3"
Jul 21 17:03:46.618569 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:46.618535    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"]
Jul 21 17:03:46.621699 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:46.621674    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-a04cd4-8wb9m"]
Jul 21 17:03:47.101732 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:47.101699    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:03:48.190418 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:03:48.190385    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="095a1958-a13e-4d38-88c7-866d3425fe12" path="/var/lib/kubelet/pods/095a1958-a13e-4d38-88c7-866d3425fe12/volumes"
Jul 21 17:04:05.011959 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:05.011879    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:04:15.713002 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:15.712961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:04:19.392164 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.392129    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"]
Jul 21 17:04:19.392692 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.392430    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095a1958-a13e-4d38-88c7-866d3425fe12" containerName="revoke-keys"
Jul 21 17:04:19.392692 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.392441    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="095a1958-a13e-4d38-88c7-866d3425fe12" containerName="revoke-keys"
Jul 21 17:04:19.392692 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.392515    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="095a1958-a13e-4d38-88c7-866d3425fe12" containerName="revoke-keys"
Jul 21 17:04:19.395541 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.395522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.398420 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.398397    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"kube-root-ca.crt\""
Jul 21 17:04:19.398543 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.398452    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"openshift-service-ca.crt\""
Jul 21 17:04:19.398543 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.398397    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"auth-test-model-07bb43-kserve-self-signed-certs\""
Jul 21 17:04:19.398741 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.398723    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"default-dockercfg-mg7hf\""
Jul 21 17:04:19.406262 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.406211    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"]
Jul 21 17:04:19.506541 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.506507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tmp-dir\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.506720 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.506580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-home\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.506720 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.506633    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-model-cache\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.506720 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.506672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tls-certs\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.506720 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.506695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-dshm\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.506852 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.506724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9zg\" (UniqueName: \"kubernetes.io/projected/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-kube-api-access-9c9zg\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608070 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-model-cache\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608070 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tls-certs\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608321 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-dshm\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608321 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9zg\" (UniqueName: \"kubernetes.io/projected/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-kube-api-access-9c9zg\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608321 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tmp-dir\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608321 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608231    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-home\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608618 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-model-cache\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608618 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tmp-dir\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.608788 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.608643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-home\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.610521 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.610499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-dshm\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.610718 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.610700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tls-certs\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.617060 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.617035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9zg\" (UniqueName: \"kubernetes.io/projected/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-kube-api-access-9c9zg\") pod \"auth-test-model-07bb43-kserve-586fd64459-dfght\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") " pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.709038 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.708950    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:19.841666 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:19.841634    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"]
Jul 21 17:04:19.844821 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:04:19.844792    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a8cd150_08b4_43f9_8a93_1f8534c86fa1.slice/crio-433a720bab24649e691051753fd98c2dcb3a7533e1944d6946933b0b2ce95f84 WatchSource:0}: Error finding container 433a720bab24649e691051753fd98c2dcb3a7533e1944d6946933b0b2ce95f84: Status 404 returned error can't find the container with id 433a720bab24649e691051753fd98c2dcb3a7533e1944d6946933b0b2ce95f84
Jul 21 17:04:20.097716 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:20.097673    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght" event={"ID":"1a8cd150-08b4-43f9-8a93-1f8534c86fa1","Type":"ContainerStarted","Data":"cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749"}
Jul 21 17:04:20.097716 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:20.097717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght" event={"ID":"1a8cd150-08b4-43f9-8a93-1f8534c86fa1","Type":"ContainerStarted","Data":"433a720bab24649e691051753fd98c2dcb3a7533e1944d6946933b0b2ce95f84"}
Jul 21 17:04:20.114430 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:20.114381    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght" podStartSLOduration=1.114364787 podStartE2EDuration="1.114364787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:04:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:04:20.113185675 +0000 UTC m=+2356.454105539" watchObservedRunningTime="2026-07-21 17:04:20.114364787 +0000 UTC m=+2356.455284651"
Jul 21 17:04:24.594813 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:24.594778    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:04:29.710067 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:29.710030    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:29.710454 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:29.710093    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:29.722933 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:29.722910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:30.156360 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:30.156326    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:04:39.187234 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.187203    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"]
Jul 21 17:04:39.190845 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.190826    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.193470 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.193441    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"kube-root-ca.crt\""
Jul 21 17:04:39.193582 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.193473    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"default-dockercfg-dccdb\""
Jul 21 17:04:39.193582 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.193509    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"openshift-service-ca.crt\""
Jul 21 17:04:39.193680 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.193577    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"auth-test-model-1e5534-kserve-self-signed-certs\""
Jul 21 17:04:39.199315 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.199294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"]
Jul 21 17:04:39.290514 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.290479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-dshm\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.290674 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.290537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94925fcf-66eb-48f2-b095-70ac51e14d53-tls-certs\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.290674 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.290588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf4sz\" (UniqueName: \"kubernetes.io/projected/94925fcf-66eb-48f2-b095-70ac51e14d53-kube-api-access-cf4sz\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.290791 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.290696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-home\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.290791 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.290764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-tmp-dir\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.290872 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.290793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-model-cache\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.391850 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.391809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-tmp-dir\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.391850 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.391853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-model-cache\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392052 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.391871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-dshm\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392052 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.391995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94925fcf-66eb-48f2-b095-70ac51e14d53-tls-certs\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392052 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.392035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf4sz\" (UniqueName: \"kubernetes.io/projected/94925fcf-66eb-48f2-b095-70ac51e14d53-kube-api-access-cf4sz\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392218 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.392102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-home\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392355 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.392333    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-model-cache\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392440 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.392377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-tmp-dir\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.392506 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.392491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-home\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.394144 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.394110    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-dshm\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.394417 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.394400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94925fcf-66eb-48f2-b095-70ac51e14d53-tls-certs\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.400428 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.400401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf4sz\" (UniqueName: \"kubernetes.io/projected/94925fcf-66eb-48f2-b095-70ac51e14d53-kube-api-access-cf4sz\") pod \"auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") " pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.501370 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.501281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:39.631266 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:39.631235    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"]
Jul 21 17:04:39.633669 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:04:39.633644    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94925fcf_66eb_48f2_b095_70ac51e14d53.slice/crio-44eee43c7cd188891d1b5034a278b43a96bbe727a8d155a1cba8328fea057403 WatchSource:0}: Error finding container 44eee43c7cd188891d1b5034a278b43a96bbe727a8d155a1cba8328fea057403: Status 404 returned error can't find the container with id 44eee43c7cd188891d1b5034a278b43a96bbe727a8d155a1cba8328fea057403
Jul 21 17:04:40.192518 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:40.192484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9" event={"ID":"94925fcf-66eb-48f2-b095-70ac51e14d53","Type":"ContainerStarted","Data":"6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5"}
Jul 21 17:04:40.192518 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:40.192521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9" event={"ID":"94925fcf-66eb-48f2-b095-70ac51e14d53","Type":"ContainerStarted","Data":"44eee43c7cd188891d1b5034a278b43a96bbe727a8d155a1cba8328fea057403"}
Jul 21 17:04:40.208804 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:40.208761    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9" podStartSLOduration=1.208745881 podStartE2EDuration="1.208745881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:04:40.207706039 +0000 UTC m=+2376.548625903" watchObservedRunningTime="2026-07-21 17:04:40.208745881 +0000 UTC m=+2376.549665744"
Jul 21 17:04:42.291727 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:42.291685    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:04:49.501645 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:49.501615    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:49.502086 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:49.501656    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:49.514188 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:49.514165    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:50.244347 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:50.244315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:04:59.184543 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:04:59.184501    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:05:04.172370 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:05:04.172339    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 17:05:04.175371 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:05:04.175350    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 17:05:04.271531 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:05:04.271496    2577 scope.go:117] "RemoveContainer" containerID="0670673ca60e74eae1cadb61b508207a7ab44eedd0f49660844f5babea9244a1"
Jul 21 17:05:15.490138 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:05:15.490097    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:05:29.206192 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:05:29.206085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:05:48.882983 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:05:48.882945    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:06:07.498638 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:07.498600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:06:25.581151 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:25.581105    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:06:41.044017 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:41.043980    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"]
Jul 21 17:06:41.880080 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:41.880042    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"]
Jul 21 17:06:44.892639 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:44.892604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:06:56.064401 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.064303    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght" podUID="1a8cd150-08b4-43f9-8a93-1f8534c86fa1" containerName="main" containerID="cri-o://cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749" gracePeriod=45
Jul 21 17:06:56.309470 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.309446    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:06:56.431268 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431239    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-home\") pod \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") "
Jul 21 17:06:56.431441 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431296    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-model-cache\") pod \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") "
Jul 21 17:06:56.431441 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431347    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tls-certs\") pod \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") "
Jul 21 17:06:56.431441 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tmp-dir\") pod \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") "
Jul 21 17:06:56.431614 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431451    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-dshm\") pod \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") "
Jul 21 17:06:56.431614 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431477    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c9zg\" (UniqueName: \"kubernetes.io/projected/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-kube-api-access-9c9zg\") pod \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\" (UID: \"1a8cd150-08b4-43f9-8a93-1f8534c86fa1\") "
Jul 21 17:06:56.431614 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431489    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-home" (OuterVolumeSpecName: "home") pod "1a8cd150-08b4-43f9-8a93-1f8534c86fa1" (UID: "1a8cd150-08b4-43f9-8a93-1f8534c86fa1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:56.431614 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431598    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a8cd150-08b4-43f9-8a93-1f8534c86fa1" (UID: "1a8cd150-08b4-43f9-8a93-1f8534c86fa1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:56.431811 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431696    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a8cd150-08b4-43f9-8a93-1f8534c86fa1" (UID: "1a8cd150-08b4-43f9-8a93-1f8534c86fa1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:56.431811 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431766    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.431811 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.431786    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.433804 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.433767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-dshm" (OuterVolumeSpecName: "dshm") pod "1a8cd150-08b4-43f9-8a93-1f8534c86fa1" (UID: "1a8cd150-08b4-43f9-8a93-1f8534c86fa1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:56.433908 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.433856    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-kube-api-access-9c9zg" (OuterVolumeSpecName: "kube-api-access-9c9zg") pod "1a8cd150-08b4-43f9-8a93-1f8534c86fa1" (UID: "1a8cd150-08b4-43f9-8a93-1f8534c86fa1"). InnerVolumeSpecName "kube-api-access-9c9zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:56.433908 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.433869    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a8cd150-08b4-43f9-8a93-1f8534c86fa1" (UID: "1a8cd150-08b4-43f9-8a93-1f8534c86fa1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:06:56.532587 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.532551    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.532587 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.532581    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.532812 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.532594    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9c9zg\" (UniqueName: \"kubernetes.io/projected/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-kube-api-access-9c9zg\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.532812 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.532607    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8cd150-08b4-43f9-8a93-1f8534c86fa1-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:56.777652 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.777565    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a8cd150-08b4-43f9-8a93-1f8534c86fa1" containerID="cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749" exitCode=0
Jul 21 17:06:56.777652 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.777612    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"
Jul 21 17:06:56.777828 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.777651    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght" event={"ID":"1a8cd150-08b4-43f9-8a93-1f8534c86fa1","Type":"ContainerDied","Data":"cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749"}
Jul 21 17:06:56.777828 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.777700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght" event={"ID":"1a8cd150-08b4-43f9-8a93-1f8534c86fa1","Type":"ContainerDied","Data":"433a720bab24649e691051753fd98c2dcb3a7533e1944d6946933b0b2ce95f84"}
Jul 21 17:06:56.777828 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.777723    2577 scope.go:117] "RemoveContainer" containerID="cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749"
Jul 21 17:06:56.786747 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.786730    2577 scope.go:117] "RemoveContainer" containerID="cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749"
Jul 21 17:06:56.786976 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:06:56.786960    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749\": container with ID starting with cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749 not found: ID does not exist" containerID="cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749"
Jul 21 17:06:56.787043 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.786981    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749"} err="failed to get container status \"cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749\": rpc error: code = NotFound desc = could not find container \"cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749\": container with ID starting with cf82dc4fbd7692117ba08b4093cca7b8a28729b77d2928c2d7748f370f394749 not found: ID does not exist"
Jul 21 17:06:56.798346 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.798322    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"]
Jul 21 17:06:56.802243 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.802221    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/auth-test-model-07bb43-kserve-586fd64459-dfght"]
Jul 21 17:06:56.900403 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:56.900369    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9" podUID="94925fcf-66eb-48f2-b095-70ac51e14d53" containerName="main" containerID="cri-o://6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5" gracePeriod=45
Jul 21 17:06:57.146624 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.146601    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:06:57.240064 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240031    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-dshm\") pod \"94925fcf-66eb-48f2-b095-70ac51e14d53\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") "
Jul 21 17:06:57.240290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240078    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94925fcf-66eb-48f2-b095-70ac51e14d53-tls-certs\") pod \"94925fcf-66eb-48f2-b095-70ac51e14d53\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") "
Jul 21 17:06:57.240290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240107    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-tmp-dir\") pod \"94925fcf-66eb-48f2-b095-70ac51e14d53\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") "
Jul 21 17:06:57.240290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240245    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf4sz\" (UniqueName: \"kubernetes.io/projected/94925fcf-66eb-48f2-b095-70ac51e14d53-kube-api-access-cf4sz\") pod \"94925fcf-66eb-48f2-b095-70ac51e14d53\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") "
Jul 21 17:06:57.240472 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-model-cache\") pod \"94925fcf-66eb-48f2-b095-70ac51e14d53\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") "
Jul 21 17:06:57.240472 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240391    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "94925fcf-66eb-48f2-b095-70ac51e14d53" (UID: "94925fcf-66eb-48f2-b095-70ac51e14d53"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:57.240472 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240408    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-home\") pod \"94925fcf-66eb-48f2-b095-70ac51e14d53\" (UID: \"94925fcf-66eb-48f2-b095-70ac51e14d53\") "
Jul 21 17:06:57.240644 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240548    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-model-cache" (OuterVolumeSpecName: "model-cache") pod "94925fcf-66eb-48f2-b095-70ac51e14d53" (UID: "94925fcf-66eb-48f2-b095-70ac51e14d53"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:57.240712 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240697    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:57.240712 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240700    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-home" (OuterVolumeSpecName: "home") pod "94925fcf-66eb-48f2-b095-70ac51e14d53" (UID: "94925fcf-66eb-48f2-b095-70ac51e14d53"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:57.240833 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.240711    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:57.242508 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.242477    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-dshm" (OuterVolumeSpecName: "dshm") pod "94925fcf-66eb-48f2-b095-70ac51e14d53" (UID: "94925fcf-66eb-48f2-b095-70ac51e14d53"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:06:57.242508 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.242487    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94925fcf-66eb-48f2-b095-70ac51e14d53-kube-api-access-cf4sz" (OuterVolumeSpecName: "kube-api-access-cf4sz") pod "94925fcf-66eb-48f2-b095-70ac51e14d53" (UID: "94925fcf-66eb-48f2-b095-70ac51e14d53"). InnerVolumeSpecName "kube-api-access-cf4sz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:06:57.242508 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.242501    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94925fcf-66eb-48f2-b095-70ac51e14d53-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "94925fcf-66eb-48f2-b095-70ac51e14d53" (UID: "94925fcf-66eb-48f2-b095-70ac51e14d53"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:06:57.341683 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.341656    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf4sz\" (UniqueName: \"kubernetes.io/projected/94925fcf-66eb-48f2-b095-70ac51e14d53-kube-api-access-cf4sz\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:57.341683 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.341683    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:57.341849 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.341693    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94925fcf-66eb-48f2-b095-70ac51e14d53-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:57.341849 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.341701    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94925fcf-66eb-48f2-b095-70ac51e14d53-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:06:57.784258 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.784173    2577 generic.go:356] "Generic (PLEG): container finished" podID="94925fcf-66eb-48f2-b095-70ac51e14d53" containerID="6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5" exitCode=0
Jul 21 17:06:57.784258 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.784219    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"
Jul 21 17:06:57.784258 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.784232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9" event={"ID":"94925fcf-66eb-48f2-b095-70ac51e14d53","Type":"ContainerDied","Data":"6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5"}
Jul 21 17:06:57.784482 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.784277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9" event={"ID":"94925fcf-66eb-48f2-b095-70ac51e14d53","Type":"ContainerDied","Data":"44eee43c7cd188891d1b5034a278b43a96bbe727a8d155a1cba8328fea057403"}
Jul 21 17:06:57.784482 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.784299    2577 scope.go:117] "RemoveContainer" containerID="6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5"
Jul 21 17:06:57.800572 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.800551    2577 scope.go:117] "RemoveContainer" containerID="6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5"
Jul 21 17:06:57.801008 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:06:57.800983    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5\": container with ID starting with 6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5 not found: ID does not exist" containerID="6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5"
Jul 21 17:06:57.801089 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.801017    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5"} err="failed to get container status \"6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5\": rpc error: code = NotFound desc = could not find container \"6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5\": container with ID starting with 6aba21ff36451d61302edc58673bd9b2e9ec7c82ab0ea1903faa79600e7536e5 not found: ID does not exist"
Jul 21 17:06:57.809781 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.809760    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"]
Jul 21 17:06:57.813735 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:57.813717    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/auth-test-model-1e5534-kserve-7bfbfd6ff9-9h2r9"]
Jul 21 17:06:58.180974 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:58.180942    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:06:58.189487 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:58.189462    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a8cd150-08b4-43f9-8a93-1f8534c86fa1" path="/var/lib/kubelet/pods/1a8cd150-08b4-43f9-8a93-1f8534c86fa1/volumes"
Jul 21 17:06:58.189844 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:06:58.189831    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94925fcf-66eb-48f2-b095-70ac51e14d53" path="/var/lib/kubelet/pods/94925fcf-66eb-48f2-b095-70ac51e14d53/volumes"
Jul 21 17:07:31.573949 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.573908    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"]
Jul 21 17:07:31.574430 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.574413    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94925fcf-66eb-48f2-b095-70ac51e14d53" containerName="main"
Jul 21 17:07:31.574480 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.574434    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="94925fcf-66eb-48f2-b095-70ac51e14d53" containerName="main"
Jul 21 17:07:31.574480 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.574456    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8cd150-08b4-43f9-8a93-1f8534c86fa1" containerName="main"
Jul 21 17:07:31.574480 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.574465    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8cd150-08b4-43f9-8a93-1f8534c86fa1" containerName="main"
Jul 21 17:07:31.574572 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.574540    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="94925fcf-66eb-48f2-b095-70ac51e14d53" containerName="main"
Jul 21 17:07:31.574572 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.574557    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8cd150-08b4-43f9-8a93-1f8534c86fa1" containerName="main"
Jul 21 17:07:31.577675 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.577656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.579884 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.579862    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"openshift-service-ca.crt\""
Jul 21 17:07:31.580525 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.580500    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"default-dockercfg-dccdb\""
Jul 21 17:07:31.580624 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.580500    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"sub-test-model-1e5534-kserve-self-signed-certs\""
Jul 21 17:07:31.580624 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.580562    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"kube-root-ca.crt\""
Jul 21 17:07:31.584325 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.584264    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"]
Jul 21 17:07:31.648742 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.648703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-dshm\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.648926 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.648752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8xcj\" (UniqueName: \"kubernetes.io/projected/c00f5464-eceb-4a67-ac61-8e6f222e2362-kube-api-access-l8xcj\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.648926 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.648876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c00f5464-eceb-4a67-ac61-8e6f222e2362-tls-certs\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.648926 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.648912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-model-cache\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.649091 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.648940    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-tmp-dir\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.649091 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.648987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-home\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.749538 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-dshm\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.749693 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8xcj\" (UniqueName: \"kubernetes.io/projected/c00f5464-eceb-4a67-ac61-8e6f222e2362-kube-api-access-l8xcj\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.749693 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c00f5464-eceb-4a67-ac61-8e6f222e2362-tls-certs\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.749693 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-model-cache\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.749693 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-tmp-dir\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.749693 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-home\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.750038 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.749995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-model-cache\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.750038 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.750022    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-tmp-dir\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.750254 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.750076    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-home\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.751927 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.751905    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-dshm\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.752104 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.752081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c00f5464-eceb-4a67-ac61-8e6f222e2362-tls-certs\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.757889 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.757866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8xcj\" (UniqueName: \"kubernetes.io/projected/c00f5464-eceb-4a67-ac61-8e6f222e2362-kube-api-access-l8xcj\") pod \"sub-test-model-1e5534-kserve-5784b78765-m7gsp\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") " pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:31.889072 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:31.889032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:32.019894 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:32.019865    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"]
Jul 21 17:07:32.022512 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:07:32.022479    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc00f5464_eceb_4a67_ac61_8e6f222e2362.slice/crio-450cd6fd5fdb66a8a449878504a9a274a03f1f2860dfcecb13092bcca0692c4b WatchSource:0}: Error finding container 450cd6fd5fdb66a8a449878504a9a274a03f1f2860dfcecb13092bcca0692c4b: Status 404 returned error can't find the container with id 450cd6fd5fdb66a8a449878504a9a274a03f1f2860dfcecb13092bcca0692c4b
Jul 21 17:07:32.939303 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:32.939271    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp" event={"ID":"c00f5464-eceb-4a67-ac61-8e6f222e2362","Type":"ContainerStarted","Data":"ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8"}
Jul 21 17:07:32.939706 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:32.939311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp" event={"ID":"c00f5464-eceb-4a67-ac61-8e6f222e2362","Type":"ContainerStarted","Data":"450cd6fd5fdb66a8a449878504a9a274a03f1f2860dfcecb13092bcca0692c4b"}
Jul 21 17:07:32.958195 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:32.958149    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp" podStartSLOduration=1.958113194 podStartE2EDuration="1.958113194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:07:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:07:32.9571456 +0000 UTC m=+2549.298065459" watchObservedRunningTime="2026-07-21 17:07:32.958113194 +0000 UTC m=+2549.299033057"
Jul 21 17:07:35.012086 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:35.012047    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:07:41.889956 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:41.889911    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:41.890458 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:41.889973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:41.902187 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:41.902164    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:07:41.990897 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:07:41.990873    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:08:43.701468 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:08:43.701384    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:09:00.798875 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:00.798840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:09:04.315548 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:04.315509    2577 scope.go:117] "RemoveContainer" containerID="05a3720f2073321cdebb3bf44081e0cbcec772854bdf203db5cd1653e1552d6f"
Jul 21 17:09:04.323380 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:04.323358    2577 scope.go:117] "RemoveContainer" containerID="c584eb951c7a03de490fe0b1300981e0d55b9803b4fdfedf4d55edb6ba96c004"
Jul 21 17:09:08.532913 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:08.532883    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"]
Jul 21 17:09:16.079280 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.079243    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"]
Jul 21 17:09:16.082558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.082539    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.084784 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.084761    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"openshift-service-ca.crt\""
Jul 21 17:09:16.085245 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.085215    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"kube-root-ca.crt\""
Jul 21 17:09:16.085245 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.085225    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"rate-test-model-07bb43-kserve-self-signed-certs\""
Jul 21 17:09:16.085378 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.085262    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-07bb43\"/\"default-dockercfg-mg7hf\""
Jul 21 17:09:16.094318 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.094290    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"]
Jul 21 17:09:16.181019 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.180980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b514152-221d-495a-bfa7-435fc3899f49-tls-certs\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.181019 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.181016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-tmp-dir\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.181256 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.181036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-dshm\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.181256 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.181157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-home\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.181256 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.181185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-model-cache\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.181256 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.181225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qpz\" (UniqueName: \"kubernetes.io/projected/2b514152-221d-495a-bfa7-435fc3899f49-kube-api-access-w2qpz\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282005 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.281968    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b514152-221d-495a-bfa7-435fc3899f49-tls-certs\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282005 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-tmp-dir\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282281 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-dshm\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282281 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-home\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282281 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-model-cache\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282281 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qpz\" (UniqueName: \"kubernetes.io/projected/2b514152-221d-495a-bfa7-435fc3899f49-kube-api-access-w2qpz\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282495 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-tmp-dir\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282495 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-home\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.282578 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.282502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-model-cache\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.284316 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.284295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-dshm\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.284617 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.284599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b514152-221d-495a-bfa7-435fc3899f49-tls-certs\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.289374 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.289346    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qpz\" (UniqueName: \"kubernetes.io/projected/2b514152-221d-495a-bfa7-435fc3899f49-kube-api-access-w2qpz\") pod \"rate-test-model-07bb43-kserve-644c79f487-gkg92\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") " pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.392250 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.392213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:16.522182 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:16.522156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"]
Jul 21 17:09:16.524362 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:09:16.524332    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b514152_221d_495a_bfa7_435fc3899f49.slice/crio-a8f0fd7f0a797c986b1710c2f27cddd58eb6437462f67c165c300ff59c441dba WatchSource:0}: Error finding container a8f0fd7f0a797c986b1710c2f27cddd58eb6437462f67c165c300ff59c441dba: Status 404 returned error can't find the container with id a8f0fd7f0a797c986b1710c2f27cddd58eb6437462f67c165c300ff59c441dba
Jul 21 17:09:17.390088 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:17.390046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92" event={"ID":"2b514152-221d-495a-bfa7-435fc3899f49","Type":"ContainerStarted","Data":"f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed"}
Jul 21 17:09:17.390484 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:17.390096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92" event={"ID":"2b514152-221d-495a-bfa7-435fc3899f49","Type":"ContainerStarted","Data":"a8f0fd7f0a797c986b1710c2f27cddd58eb6437462f67c165c300ff59c441dba"}
Jul 21 17:09:17.408904 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:17.408837    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92" podStartSLOduration=1.408820143 podStartE2EDuration="1.408820143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:09:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:09:17.408199672 +0000 UTC m=+2653.749119532" watchObservedRunningTime="2026-07-21 17:09:17.408820143 +0000 UTC m=+2653.749740025"
Jul 21 17:09:19.885301 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:19.885265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:09:23.552598 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.552558    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp" podUID="c00f5464-eceb-4a67-ac61-8e6f222e2362" containerName="main" containerID="cri-o://ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8" gracePeriod=45
Jul 21 17:09:23.794732 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.794711    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:09:23.953274 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953243    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-dshm\") pod \"c00f5464-eceb-4a67-ac61-8e6f222e2362\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") "
Jul 21 17:09:23.953464 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953311    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-tmp-dir\") pod \"c00f5464-eceb-4a67-ac61-8e6f222e2362\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") "
Jul 21 17:09:23.953464 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c00f5464-eceb-4a67-ac61-8e6f222e2362-tls-certs\") pod \"c00f5464-eceb-4a67-ac61-8e6f222e2362\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") "
Jul 21 17:09:23.953464 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953393    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-model-cache\") pod \"c00f5464-eceb-4a67-ac61-8e6f222e2362\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") "
Jul 21 17:09:23.953464 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953417    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8xcj\" (UniqueName: \"kubernetes.io/projected/c00f5464-eceb-4a67-ac61-8e6f222e2362-kube-api-access-l8xcj\") pod \"c00f5464-eceb-4a67-ac61-8e6f222e2362\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") "
Jul 21 17:09:23.953464 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953455    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-home\") pod \"c00f5464-eceb-4a67-ac61-8e6f222e2362\" (UID: \"c00f5464-eceb-4a67-ac61-8e6f222e2362\") "
Jul 21 17:09:23.953715 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953545    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c00f5464-eceb-4a67-ac61-8e6f222e2362" (UID: "c00f5464-eceb-4a67-ac61-8e6f222e2362"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:23.953715 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953658    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-model-cache" (OuterVolumeSpecName: "model-cache") pod "c00f5464-eceb-4a67-ac61-8e6f222e2362" (UID: "c00f5464-eceb-4a67-ac61-8e6f222e2362"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:23.953807 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953729    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-home" (OuterVolumeSpecName: "home") pod "c00f5464-eceb-4a67-ac61-8e6f222e2362" (UID: "c00f5464-eceb-4a67-ac61-8e6f222e2362"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:23.953870 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953824    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:09:23.953870 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.953845    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:09:23.955432 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.955402    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-dshm" (OuterVolumeSpecName: "dshm") pod "c00f5464-eceb-4a67-ac61-8e6f222e2362" (UID: "c00f5464-eceb-4a67-ac61-8e6f222e2362"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:09:23.955432 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.955421    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c00f5464-eceb-4a67-ac61-8e6f222e2362-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c00f5464-eceb-4a67-ac61-8e6f222e2362" (UID: "c00f5464-eceb-4a67-ac61-8e6f222e2362"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:09:23.955577 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:23.955511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00f5464-eceb-4a67-ac61-8e6f222e2362-kube-api-access-l8xcj" (OuterVolumeSpecName: "kube-api-access-l8xcj") pod "c00f5464-eceb-4a67-ac61-8e6f222e2362" (UID: "c00f5464-eceb-4a67-ac61-8e6f222e2362"). InnerVolumeSpecName "kube-api-access-l8xcj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:09:24.055074 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.055044    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c00f5464-eceb-4a67-ac61-8e6f222e2362-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:09:24.055074 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.055069    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8xcj\" (UniqueName: \"kubernetes.io/projected/c00f5464-eceb-4a67-ac61-8e6f222e2362-kube-api-access-l8xcj\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:09:24.055074 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.055079    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:09:24.055304 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.055087    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c00f5464-eceb-4a67-ac61-8e6f222e2362-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:09:24.424438 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.424407    2577 generic.go:356] "Generic (PLEG): container finished" podID="c00f5464-eceb-4a67-ac61-8e6f222e2362" containerID="ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8" exitCode=0
Jul 21 17:09:24.424438 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.424443    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp" event={"ID":"c00f5464-eceb-4a67-ac61-8e6f222e2362","Type":"ContainerDied","Data":"ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8"}
Jul 21 17:09:24.424683 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.424472    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp" event={"ID":"c00f5464-eceb-4a67-ac61-8e6f222e2362","Type":"ContainerDied","Data":"450cd6fd5fdb66a8a449878504a9a274a03f1f2860dfcecb13092bcca0692c4b"}
Jul 21 17:09:24.424683 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.424477    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"
Jul 21 17:09:24.424683 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.424487    2577 scope.go:117] "RemoveContainer" containerID="ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8"
Jul 21 17:09:24.433218 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.433197    2577 scope.go:117] "RemoveContainer" containerID="ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8"
Jul 21 17:09:24.433464 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:09:24.433444    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8\": container with ID starting with ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8 not found: ID does not exist" containerID="ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8"
Jul 21 17:09:24.433535 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.433473    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8"} err="failed to get container status \"ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8\": rpc error: code = NotFound desc = could not find container \"ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8\": container with ID starting with ad8545cf6b29050cbcfd566bfce941de4d34c2a51989fa1f4305fd80032c28a8 not found: ID does not exist"
Jul 21 17:09:24.439765 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.439743    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"]
Jul 21 17:09:24.445528 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:24.445509    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/sub-test-model-1e5534-kserve-5784b78765-m7gsp"]
Jul 21 17:09:26.190516 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:26.190482    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00f5464-eceb-4a67-ac61-8e6f222e2362" path="/var/lib/kubelet/pods/c00f5464-eceb-4a67-ac61-8e6f222e2362/volumes"
Jul 21 17:09:26.393073 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:26.393037    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:26.393073 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:26.393088    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:26.405558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:26.405531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:09:26.444904 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:09:26.444820    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:10:04.203154 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:04.203066    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 17:10:04.208669 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:04.208641    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wr2q7_04905b25-566b-4f4d-8d8f-61b68d8976ad/ovn-acl-logging/0.log"
Jul 21 17:10:04.342561 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:04.342529    2577 scope.go:117] "RemoveContainer" containerID="e0e424e37233177b4460ad957f9b10991bc71a9d91e6a438d1785c69f3b95a47"
Jul 21 17:10:12.678336 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.678300    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"]
Jul 21 17:10:12.678698 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.678655    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00f5464-eceb-4a67-ac61-8e6f222e2362" containerName="main"
Jul 21 17:10:12.678698 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.678669    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00f5464-eceb-4a67-ac61-8e6f222e2362" containerName="main"
Jul 21 17:10:12.678770 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.678720    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00f5464-eceb-4a67-ac61-8e6f222e2362" containerName="main"
Jul 21 17:10:12.681420 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.681398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.684030 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.684002    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"kube-root-ca.crt\""
Jul 21 17:10:12.684176 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.684036    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"default-dockercfg-dccdb\""
Jul 21 17:10:12.684176 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.684060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"rate-test-model-1e5534-kserve-self-signed-certs\""
Jul 21 17:10:12.684176 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.684063    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1e5534\"/\"openshift-service-ca.crt\""
Jul 21 17:10:12.692348 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.692326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"]
Jul 21 17:10:12.783485 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.783452    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6813f2db-3396-499f-93ad-cd211599d716-tls-certs\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.783485 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.783495    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-model-cache\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.783699 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.783515    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-tmp-dir\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.783699 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.783531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g2vh\" (UniqueName: \"kubernetes.io/projected/6813f2db-3396-499f-93ad-cd211599d716-kube-api-access-4g2vh\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.783699 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.783588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-home\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.783699 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.783650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-dshm\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884396 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-model-cache\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-tmp-dir\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g2vh\" (UniqueName: \"kubernetes.io/projected/6813f2db-3396-499f-93ad-cd211599d716-kube-api-access-4g2vh\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-home\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-dshm\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6813f2db-3396-499f-93ad-cd211599d716-tls-certs\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884854 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884763    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-model-cache\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884854 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884833    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-tmp-dir\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.884940 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.884891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-home\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.886842 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.886812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-dshm\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.887070 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.887051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6813f2db-3396-499f-93ad-cd211599d716-tls-certs\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.894401 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.894379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g2vh\" (UniqueName: \"kubernetes.io/projected/6813f2db-3396-499f-93ad-cd211599d716-kube-api-access-4g2vh\") pod \"rate-test-model-1e5534-kserve-6f484b8c87-k9tzx\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") " pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:12.990620 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:12.990530    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:13.120827 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:13.120799    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"]
Jul 21 17:10:13.123509 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:10:13.123483    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6813f2db_3396_499f_93ad_cd211599d716.slice/crio-13af0867acf7a4bfee59b418806390bfcfb750a2652b55a1b175e1da24a30871 WatchSource:0}: Error finding container 13af0867acf7a4bfee59b418806390bfcfb750a2652b55a1b175e1da24a30871: Status 404 returned error can't find the container with id 13af0867acf7a4bfee59b418806390bfcfb750a2652b55a1b175e1da24a30871
Jul 21 17:10:13.633474 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:13.633436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx" event={"ID":"6813f2db-3396-499f-93ad-cd211599d716","Type":"ContainerStarted","Data":"c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003"}
Jul 21 17:10:13.633474 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:13.633479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx" event={"ID":"6813f2db-3396-499f-93ad-cd211599d716","Type":"ContainerStarted","Data":"13af0867acf7a4bfee59b418806390bfcfb750a2652b55a1b175e1da24a30871"}
Jul 21 17:10:13.651632 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:13.651587    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx" podStartSLOduration=1.65157307 podStartE2EDuration="1.65157307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:10:13.650493049 +0000 UTC m=+2709.991412912" watchObservedRunningTime="2026-07-21 17:10:13.65157307 +0000 UTC m=+2709.992492932"
Jul 21 17:10:16.292796 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:16.292759    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:10:22.990795 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:22.990756    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:22.991208 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:22.990872    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:23.003077 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:23.003049    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:23.687242 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:23.687207    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:10:34.384482 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:34.384449    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:10:49.488548 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:49.488509    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:10:56.538273 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:56.538240    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"]
Jul 21 17:10:57.379140 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:57.379090    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"]
Jul 21 17:10:58.324841 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.324809    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-139884325862704"]
Jul 21 17:10:58.328404 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.328385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:10:58.330567 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.330550    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ntrxf\""
Jul 21 17:10:58.338144 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.335792    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325862704"]
Jul 21 17:10:58.486399 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.486352    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzmzf\" (UniqueName: \"kubernetes.io/projected/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5-kube-api-access-vzmzf\") pod \"test-curl-7791-139884325862704\" (UID: \"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5\") " pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:10:58.587896 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.587869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzmzf\" (UniqueName: \"kubernetes.io/projected/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5-kube-api-access-vzmzf\") pod \"test-curl-7791-139884325862704\" (UID: \"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5\") " pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:10:58.596019 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.595989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzmzf\" (UniqueName: \"kubernetes.io/projected/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5-kube-api-access-vzmzf\") pod \"test-curl-7791-139884325862704\" (UID: \"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5\") " pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:10:58.643173 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.643150    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:10:58.774610 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.774473    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325862704"]
Jul 21 17:10:58.777283 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:10:58.777237    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod98fadcbb_2d48_49f7_a4e6_cf59e367dfb5.slice/crio-01021f7e8497d0dff566350624929147c0ee30d2c7f9d019ed9084d603d8401b WatchSource:0}: Error finding container 01021f7e8497d0dff566350624929147c0ee30d2c7f9d019ed9084d603d8401b: Status 404 returned error can't find the container with id 01021f7e8497d0dff566350624929147c0ee30d2c7f9d019ed9084d603d8401b
Jul 21 17:10:58.778555 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.778532    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:10:58.831558 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:58.831530    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325862704" event={"ID":"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5","Type":"ContainerStarted","Data":"01021f7e8497d0dff566350624929147c0ee30d2c7f9d019ed9084d603d8401b"}
Jul 21 17:10:59.837447 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:59.837359    2577 generic.go:356] "Generic (PLEG): container finished" podID="98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" containerID="350fe90741622576de3a05a6fc2db420a075d460859d45fd37a87550053539c0" exitCode=0
Jul 21 17:10:59.837801 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:10:59.837449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325862704" event={"ID":"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5","Type":"ContainerDied","Data":"350fe90741622576de3a05a6fc2db420a075d460859d45fd37a87550053539c0"}
Jul 21 17:11:00.971926 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:00.971901    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:11:01.018679 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.018648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7791-139884325862704_98fadcbb-2d48-49f7-a4e6-cf59e367dfb5/test-curl-7791-139884325862704/0.log"
Jul 21 17:11:01.038853 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.038823    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-139884325862704"]
Jul 21 17:11:01.043358 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.043335    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-139884325862704"]
Jul 21 17:11:01.111794 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.111727    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzmzf\" (UniqueName: \"kubernetes.io/projected/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5-kube-api-access-vzmzf\") pod \"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5\" (UID: \"98fadcbb-2d48-49f7-a4e6-cf59e367dfb5\") "
Jul 21 17:11:01.113962 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.113932    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5-kube-api-access-vzmzf" (OuterVolumeSpecName: "kube-api-access-vzmzf") pod "98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" (UID: "98fadcbb-2d48-49f7-a4e6-cf59e367dfb5"). InnerVolumeSpecName "kube-api-access-vzmzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:01.212691 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.212647    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzmzf\" (UniqueName: \"kubernetes.io/projected/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5-kube-api-access-vzmzf\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:01.847448 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.847415    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="01021f7e8497d0dff566350624929147c0ee30d2c7f9d019ed9084d603d8401b"
Jul 21 17:11:01.847448 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:01.847425    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:11:01.857178 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:11:01.857147    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7791-139884325862704\" is forbidden: User \"system:node:ip-10-0-142-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-11.ec2.internal' and this object" podUID="98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" pod="opendatahub/test-curl-7791-139884325862704"
Jul 21 17:11:02.192841 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:02.192762    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" path="/var/lib/kubelet/pods/98fadcbb-2d48-49f7-a4e6-cf59e367dfb5/volumes"
Jul 21 17:11:04.463781 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.463749    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:04.464203 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.464079    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" containerName="test-curl-7791-139884325862704"
Jul 21 17:11:04.464203 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.464091    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" containerName="test-curl-7791-139884325862704"
Jul 21 17:11:04.464203 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.464188    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="98fadcbb-2d48-49f7-a4e6-cf59e367dfb5" containerName="test-curl-7791-139884325862704"
Jul 21 17:11:04.467281 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.467265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:04.469025 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.469006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ntrxf\""
Jul 21 17:11:04.479142 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.475968    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:04.644990 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.644958    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flmvs\" (UniqueName: \"kubernetes.io/projected/79f9ff9d-a980-43ff-9b71-34a398f457b7-kube-api-access-flmvs\") pod \"test-curl-7791-139884325676784\" (UID: \"79f9ff9d-a980-43ff-9b71-34a398f457b7\") " pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:04.745645 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.745551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flmvs\" (UniqueName: \"kubernetes.io/projected/79f9ff9d-a980-43ff-9b71-34a398f457b7-kube-api-access-flmvs\") pod \"test-curl-7791-139884325676784\" (UID: \"79f9ff9d-a980-43ff-9b71-34a398f457b7\") " pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:04.754016 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.753975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flmvs\" (UniqueName: \"kubernetes.io/projected/79f9ff9d-a980-43ff-9b71-34a398f457b7-kube-api-access-flmvs\") pod \"test-curl-7791-139884325676784\" (UID: \"79f9ff9d-a980-43ff-9b71-34a398f457b7\") " pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:04.779181 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.779157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:04.905811 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:04.905785    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:04.908042 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:11:04.908009    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79f9ff9d_a980_43ff_9b71_34a398f457b7.slice/crio-8eb82773d427c9a648d15fccb0fc582028992a2154838a720bd30528bce1495c WatchSource:0}: Error finding container 8eb82773d427c9a648d15fccb0fc582028992a2154838a720bd30528bce1495c: Status 404 returned error can't find the container with id 8eb82773d427c9a648d15fccb0fc582028992a2154838a720bd30528bce1495c
Jul 21 17:11:05.866834 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:05.866803    2577 generic.go:356] "Generic (PLEG): container finished" podID="79f9ff9d-a980-43ff-9b71-34a398f457b7" containerID="520ca819849ccc5c5c0baffabef856b76f6a31695779e24cb637a901eab6ec76" exitCode=0
Jul 21 17:11:05.867218 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:05.866894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325676784" event={"ID":"79f9ff9d-a980-43ff-9b71-34a398f457b7","Type":"ContainerDied","Data":"520ca819849ccc5c5c0baffabef856b76f6a31695779e24cb637a901eab6ec76"}
Jul 21 17:11:05.867218 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:05.866939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325676784" event={"ID":"79f9ff9d-a980-43ff-9b71-34a398f457b7","Type":"ContainerStarted","Data":"8eb82773d427c9a648d15fccb0fc582028992a2154838a720bd30528bce1495c"}
Jul 21 17:11:06.997938 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:06.997915    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.018567 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.018546    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7791-139884325676784_79f9ff9d-a980-43ff-9b71-34a398f457b7/test-curl-7791-139884325676784/0.log"
Jul 21 17:11:07.042103 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.042077    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:07.048031 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.048007    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-139884325676784"]
Jul 21 17:11:07.065843 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.065822    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flmvs\" (UniqueName: \"kubernetes.io/projected/79f9ff9d-a980-43ff-9b71-34a398f457b7-kube-api-access-flmvs\") pod \"79f9ff9d-a980-43ff-9b71-34a398f457b7\" (UID: \"79f9ff9d-a980-43ff-9b71-34a398f457b7\") "
Jul 21 17:11:07.067830 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.067804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79f9ff9d-a980-43ff-9b71-34a398f457b7-kube-api-access-flmvs" (OuterVolumeSpecName: "kube-api-access-flmvs") pod "79f9ff9d-a980-43ff-9b71-34a398f457b7" (UID: "79f9ff9d-a980-43ff-9b71-34a398f457b7"). InnerVolumeSpecName "kube-api-access-flmvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:07.167092 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.167004    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flmvs\" (UniqueName: \"kubernetes.io/projected/79f9ff9d-a980-43ff-9b71-34a398f457b7-kube-api-access-flmvs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:07.876868 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.876831    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:07.876868 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:07.876866    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eb82773d427c9a648d15fccb0fc582028992a2154838a720bd30528bce1495c"
Jul 21 17:11:07.886442 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:11:07.886416    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7791-139884325676784\" is forbidden: User \"system:node:ip-10-0-142-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-11.ec2.internal' and this object" podUID="79f9ff9d-a980-43ff-9b71-34a398f457b7" pod="opendatahub/test-curl-7791-139884325676784"
Jul 21 17:11:08.190002 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:08.189919    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79f9ff9d-a980-43ff-9b71-34a398f457b7" path="/var/lib/kubelet/pods/79f9ff9d-a980-43ff-9b71-34a398f457b7/volumes"
Jul 21 17:11:10.082435 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:10.082399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:11:11.557905 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.557848    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92" podUID="2b514152-221d-495a-bfa7-435fc3899f49" containerName="main" containerID="cri-o://f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed" gracePeriod=45
Jul 21 17:11:11.799727 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.799701    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:11:11.894926 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.894894    2577 generic.go:356] "Generic (PLEG): container finished" podID="2b514152-221d-495a-bfa7-435fc3899f49" containerID="f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed" exitCode=0
Jul 21 17:11:11.895081 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.894940    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"
Jul 21 17:11:11.895081 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.894942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92" event={"ID":"2b514152-221d-495a-bfa7-435fc3899f49","Type":"ContainerDied","Data":"f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed"}
Jul 21 17:11:11.895081 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.895065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92" event={"ID":"2b514152-221d-495a-bfa7-435fc3899f49","Type":"ContainerDied","Data":"a8f0fd7f0a797c986b1710c2f27cddd58eb6437462f67c165c300ff59c441dba"}
Jul 21 17:11:11.895228 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.895092    2577 scope.go:117] "RemoveContainer" containerID="f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed"
Jul 21 17:11:11.903131 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.903098    2577 scope.go:117] "RemoveContainer" containerID="f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed"
Jul 21 17:11:11.903374 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:11:11.903355    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed\": container with ID starting with f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed not found: ID does not exist" containerID="f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed"
Jul 21 17:11:11.903441 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.903388    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed"} err="failed to get container status \"f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed\": rpc error: code = NotFound desc = could not find container \"f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed\": container with ID starting with f0b9a0c0f2a9684c9aad412a4514f57a9292813df5234cda85382fa5cff907ed not found: ID does not exist"
Jul 21 17:11:11.909645 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909627    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-dshm\") pod \"2b514152-221d-495a-bfa7-435fc3899f49\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") "
Jul 21 17:11:11.909726 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909655    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-home\") pod \"2b514152-221d-495a-bfa7-435fc3899f49\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") "
Jul 21 17:11:11.909726 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909698    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2qpz\" (UniqueName: \"kubernetes.io/projected/2b514152-221d-495a-bfa7-435fc3899f49-kube-api-access-w2qpz\") pod \"2b514152-221d-495a-bfa7-435fc3899f49\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") "
Jul 21 17:11:11.909726 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909723    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-tmp-dir\") pod \"2b514152-221d-495a-bfa7-435fc3899f49\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") "
Jul 21 17:11:11.909839 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b514152-221d-495a-bfa7-435fc3899f49-tls-certs\") pod \"2b514152-221d-495a-bfa7-435fc3899f49\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") "
Jul 21 17:11:11.909839 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-model-cache\") pod \"2b514152-221d-495a-bfa7-435fc3899f49\" (UID: \"2b514152-221d-495a-bfa7-435fc3899f49\") "
Jul 21 17:11:11.909945 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.909922    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-home" (OuterVolumeSpecName: "home") pod "2b514152-221d-495a-bfa7-435fc3899f49" (UID: "2b514152-221d-495a-bfa7-435fc3899f49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:11.910060 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.910018    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b514152-221d-495a-bfa7-435fc3899f49" (UID: "2b514152-221d-495a-bfa7-435fc3899f49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:11.910145 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.910075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b514152-221d-495a-bfa7-435fc3899f49" (UID: "2b514152-221d-495a-bfa7-435fc3899f49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:11.910198 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.910147    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:11.910198 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.910161    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:11.911730 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.911702    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-dshm" (OuterVolumeSpecName: "dshm") pod "2b514152-221d-495a-bfa7-435fc3899f49" (UID: "2b514152-221d-495a-bfa7-435fc3899f49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:11.911817 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.911735    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b514152-221d-495a-bfa7-435fc3899f49-kube-api-access-w2qpz" (OuterVolumeSpecName: "kube-api-access-w2qpz") pod "2b514152-221d-495a-bfa7-435fc3899f49" (UID: "2b514152-221d-495a-bfa7-435fc3899f49"). InnerVolumeSpecName "kube-api-access-w2qpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:11.911817 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:11.911763    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b514152-221d-495a-bfa7-435fc3899f49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b514152-221d-495a-bfa7-435fc3899f49" (UID: "2b514152-221d-495a-bfa7-435fc3899f49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:12.011554 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.011521    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.011554 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.011554    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2qpz\" (UniqueName: \"kubernetes.io/projected/2b514152-221d-495a-bfa7-435fc3899f49-kube-api-access-w2qpz\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.011703 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.011566    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b514152-221d-495a-bfa7-435fc3899f49-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.011703 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.011577    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b514152-221d-495a-bfa7-435fc3899f49-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.213996 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.213964    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"]
Jul 21 17:11:12.220094 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.220070    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-07bb43/rate-test-model-07bb43-kserve-644c79f487-gkg92"]
Jul 21 17:11:12.398725 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.398669    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx" podUID="6813f2db-3396-499f-93ad-cd211599d716" containerName="main" containerID="cri-o://c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003" gracePeriod=45
Jul 21 17:11:12.468577 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468509    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:12.468830 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468817    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79f9ff9d-a980-43ff-9b71-34a398f457b7" containerName="test-curl-7791-139884325676784"
Jul 21 17:11:12.468875 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468832    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="79f9ff9d-a980-43ff-9b71-34a398f457b7" containerName="test-curl-7791-139884325676784"
Jul 21 17:11:12.468875 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468857    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b514152-221d-495a-bfa7-435fc3899f49" containerName="main"
Jul 21 17:11:12.468875 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468863    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b514152-221d-495a-bfa7-435fc3899f49" containerName="main"
Jul 21 17:11:12.468974 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468913    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="79f9ff9d-a980-43ff-9b71-34a398f457b7" containerName="test-curl-7791-139884325676784"
Jul 21 17:11:12.468974 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.468922    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b514152-221d-495a-bfa7-435fc3899f49" containerName="main"
Jul 21 17:11:12.471651 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.471634    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:12.473625 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.473610    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ntrxf\""
Jul 21 17:11:12.476461 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.476438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:12.517399 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.517378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zv6s\" (UniqueName: \"kubernetes.io/projected/37665713-b6dc-4b0d-8112-b6bbb0f98477-kube-api-access-5zv6s\") pod \"test-curl-7791-139884325677792\" (UID: \"37665713-b6dc-4b0d-8112-b6bbb0f98477\") " pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:12.618064 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.618024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zv6s\" (UniqueName: \"kubernetes.io/projected/37665713-b6dc-4b0d-8112-b6bbb0f98477-kube-api-access-5zv6s\") pod \"test-curl-7791-139884325677792\" (UID: \"37665713-b6dc-4b0d-8112-b6bbb0f98477\") " pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:12.627448 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.627419    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zv6s\" (UniqueName: \"kubernetes.io/projected/37665713-b6dc-4b0d-8112-b6bbb0f98477-kube-api-access-5zv6s\") pod \"test-curl-7791-139884325677792\" (UID: \"37665713-b6dc-4b0d-8112-b6bbb0f98477\") " pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:12.659644 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.659616    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:11:12.719057 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.718974    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-home\") pod \"6813f2db-3396-499f-93ad-cd211599d716\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") "
Jul 21 17:11:12.719057 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719019    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-tmp-dir\") pod \"6813f2db-3396-499f-93ad-cd211599d716\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") "
Jul 21 17:11:12.719290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719064    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6813f2db-3396-499f-93ad-cd211599d716-tls-certs\") pod \"6813f2db-3396-499f-93ad-cd211599d716\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") "
Jul 21 17:11:12.719290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719091    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-model-cache\") pod \"6813f2db-3396-499f-93ad-cd211599d716\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") "
Jul 21 17:11:12.719290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719108    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g2vh\" (UniqueName: \"kubernetes.io/projected/6813f2db-3396-499f-93ad-cd211599d716-kube-api-access-4g2vh\") pod \"6813f2db-3396-499f-93ad-cd211599d716\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") "
Jul 21 17:11:12.719290 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-dshm\") pod \"6813f2db-3396-499f-93ad-cd211599d716\" (UID: \"6813f2db-3396-499f-93ad-cd211599d716\") "
Jul 21 17:11:12.719501 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719281    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-home" (OuterVolumeSpecName: "home") pod "6813f2db-3396-499f-93ad-cd211599d716" (UID: "6813f2db-3396-499f-93ad-cd211599d716"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:12.719501 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719374    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6813f2db-3396-499f-93ad-cd211599d716" (UID: "6813f2db-3396-499f-93ad-cd211599d716"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:12.719501 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719398    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-model-cache" (OuterVolumeSpecName: "model-cache") pod "6813f2db-3396-499f-93ad-cd211599d716" (UID: "6813f2db-3396-499f-93ad-cd211599d716"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:12.719501 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719482    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-model-cache\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.719501 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719499    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-home\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.719676 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.719512    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-tmp-dir\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.721321 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.721299    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-dshm" (OuterVolumeSpecName: "dshm") pod "6813f2db-3396-499f-93ad-cd211599d716" (UID: "6813f2db-3396-499f-93ad-cd211599d716"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:11:12.721431 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.721342    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6813f2db-3396-499f-93ad-cd211599d716-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6813f2db-3396-499f-93ad-cd211599d716" (UID: "6813f2db-3396-499f-93ad-cd211599d716"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:11:12.721431 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.721378    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6813f2db-3396-499f-93ad-cd211599d716-kube-api-access-4g2vh" (OuterVolumeSpecName: "kube-api-access-4g2vh") pod "6813f2db-3396-499f-93ad-cd211599d716" (UID: "6813f2db-3396-499f-93ad-cd211599d716"). InnerVolumeSpecName "kube-api-access-4g2vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:12.781593 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.781557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:12.820135 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.820083    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g2vh\" (UniqueName: \"kubernetes.io/projected/6813f2db-3396-499f-93ad-cd211599d716-kube-api-access-4g2vh\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.820135 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.820114    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6813f2db-3396-499f-93ad-cd211599d716-dshm\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.820280 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.820147    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6813f2db-3396-499f-93ad-cd211599d716-tls-certs\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:12.902648 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.902617    2577 generic.go:356] "Generic (PLEG): container finished" podID="6813f2db-3396-499f-93ad-cd211599d716" containerID="c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003" exitCode=0
Jul 21 17:11:12.902824 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.902658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx" event={"ID":"6813f2db-3396-499f-93ad-cd211599d716","Type":"ContainerDied","Data":"c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003"}
Jul 21 17:11:12.902824 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.902664    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"
Jul 21 17:11:12.902824 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.902687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx" event={"ID":"6813f2db-3396-499f-93ad-cd211599d716","Type":"ContainerDied","Data":"13af0867acf7a4bfee59b418806390bfcfb750a2652b55a1b175e1da24a30871"}
Jul 21 17:11:12.902824 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.902702    2577 scope.go:117] "RemoveContainer" containerID="c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003"
Jul 21 17:11:12.911597 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.911570    2577 scope.go:117] "RemoveContainer" containerID="c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003"
Jul 21 17:11:12.911981 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:11:12.911942    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003\": container with ID starting with c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003 not found: ID does not exist" containerID="c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003"
Jul 21 17:11:12.912072 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.911988    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003"} err="failed to get container status \"c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003\": rpc error: code = NotFound desc = could not find container \"c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003\": container with ID starting with c4562581255dd4d20c08b11d9281f1212fbefb88691a9f9bf53ea19078db6003 not found: ID does not exist"
Jul 21 17:11:12.913207 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.913188    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:12.915644 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:11:12.915620    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37665713_b6dc_4b0d_8112_b6bbb0f98477.slice/crio-f7f8cc66da1aa18432d6160d792e1496d7ce86b019cd9d2d7b7ef43d8cff51c1 WatchSource:0}: Error finding container f7f8cc66da1aa18432d6160d792e1496d7ce86b019cd9d2d7b7ef43d8cff51c1: Status 404 returned error can't find the container with id f7f8cc66da1aa18432d6160d792e1496d7ce86b019cd9d2d7b7ef43d8cff51c1
Jul 21 17:11:12.923675 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.923653    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"]
Jul 21 17:11:12.928199 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:12.928169    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1e5534/rate-test-model-1e5534-kserve-6f484b8c87-k9tzx"]
Jul 21 17:11:13.909842 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:13.909802    2577 generic.go:356] "Generic (PLEG): container finished" podID="37665713-b6dc-4b0d-8112-b6bbb0f98477" containerID="e566db0e164fcf9f58266f1478f898ff033f3d9bc097c8e582b79ee479a5d71e" exitCode=0
Jul 21 17:11:13.909842 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:13.909834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325677792" event={"ID":"37665713-b6dc-4b0d-8112-b6bbb0f98477","Type":"ContainerDied","Data":"e566db0e164fcf9f58266f1478f898ff033f3d9bc097c8e582b79ee479a5d71e"}
Jul 21 17:11:13.910465 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:13.909880    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7791-139884325677792" event={"ID":"37665713-b6dc-4b0d-8112-b6bbb0f98477","Type":"ContainerStarted","Data":"f7f8cc66da1aa18432d6160d792e1496d7ce86b019cd9d2d7b7ef43d8cff51c1"}
Jul 21 17:11:14.190023 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:14.189944    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b514152-221d-495a-bfa7-435fc3899f49" path="/var/lib/kubelet/pods/2b514152-221d-495a-bfa7-435fc3899f49/volumes"
Jul 21 17:11:14.190377 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:14.190362    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6813f2db-3396-499f-93ad-cd211599d716" path="/var/lib/kubelet/pods/6813f2db-3396-499f-93ad-cd211599d716/volumes"
Jul 21 17:11:15.049654 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.049631    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:15.072777 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.072748    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7791-139884325677792_37665713-b6dc-4b0d-8112-b6bbb0f98477/test-curl-7791-139884325677792/0.log"
Jul 21 17:11:15.113525 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.113498    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:15.118317 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.118297    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7791-139884325677792"]
Jul 21 17:11:15.139368 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.139348    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zv6s\" (UniqueName: \"kubernetes.io/projected/37665713-b6dc-4b0d-8112-b6bbb0f98477-kube-api-access-5zv6s\") pod \"37665713-b6dc-4b0d-8112-b6bbb0f98477\" (UID: \"37665713-b6dc-4b0d-8112-b6bbb0f98477\") "
Jul 21 17:11:15.141345 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.141323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37665713-b6dc-4b0d-8112-b6bbb0f98477-kube-api-access-5zv6s" (OuterVolumeSpecName: "kube-api-access-5zv6s") pod "37665713-b6dc-4b0d-8112-b6bbb0f98477" (UID: "37665713-b6dc-4b0d-8112-b6bbb0f98477"). InnerVolumeSpecName "kube-api-access-5zv6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:11:15.240687 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.240579    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zv6s\" (UniqueName: \"kubernetes.io/projected/37665713-b6dc-4b0d-8112-b6bbb0f98477-kube-api-access-5zv6s\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:15.305254 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305221    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"]
Jul 21 17:11:15.305543 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305531    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37665713-b6dc-4b0d-8112-b6bbb0f98477" containerName="test-curl-7791-139884325677792"
Jul 21 17:11:15.305632 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305545    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="37665713-b6dc-4b0d-8112-b6bbb0f98477" containerName="test-curl-7791-139884325677792"
Jul 21 17:11:15.305632 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305570    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6813f2db-3396-499f-93ad-cd211599d716" containerName="main"
Jul 21 17:11:15.305632 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305576    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6813f2db-3396-499f-93ad-cd211599d716" containerName="main"
Jul 21 17:11:15.305632 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305628    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="37665713-b6dc-4b0d-8112-b6bbb0f98477" containerName="test-curl-7791-139884325677792"
Jul 21 17:11:15.305751 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.305639    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6813f2db-3396-499f-93ad-cd211599d716" containerName="main"
Jul 21 17:11:15.308569 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.308552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:15.310716 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.310691    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:11:15.310835 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.310748    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 17:11:15.315726 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.315599    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"]
Jul 21 17:11:15.341427 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.341403    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17a58a4-05c5-47c7-9f63-5ac655406231-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6\" (UID: \"a17a58a4-05c5-47c7-9f63-5ac655406231\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:15.442811 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.442774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17a58a4-05c5-47c7-9f63-5ac655406231-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6\" (UID: \"a17a58a4-05c5-47c7-9f63-5ac655406231\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:15.443467 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.443439    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17a58a4-05c5-47c7-9f63-5ac655406231-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6\" (UID: \"a17a58a4-05c5-47c7-9f63-5ac655406231\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:15.620216 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.620185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:15.750435 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.750412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"]
Jul 21 17:11:15.752420 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:11:15.752394    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda17a58a4_05c5_47c7_9f63_5ac655406231.slice/crio-445b11f135ce598e30b8646cab657b770ace7386c9a5ccfc249288906e3a7b35 WatchSource:0}: Error finding container 445b11f135ce598e30b8646cab657b770ace7386c9a5ccfc249288906e3a7b35: Status 404 returned error can't find the container with id 445b11f135ce598e30b8646cab657b770ace7386c9a5ccfc249288906e3a7b35
Jul 21 17:11:15.919222 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.919133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6" event={"ID":"a17a58a4-05c5-47c7-9f63-5ac655406231","Type":"ContainerStarted","Data":"445b11f135ce598e30b8646cab657b770ace7386c9a5ccfc249288906e3a7b35"}
Jul 21 17:11:15.925994 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.925967    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7f8cc66da1aa18432d6160d792e1496d7ce86b019cd9d2d7b7ef43d8cff51c1"
Jul 21 17:11:15.925994 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:15.925973    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:15.935730 ip-10-0-142-11 kubenswrapper[2577]: E0721 17:11:15.935706    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7791-139884325677792\" is forbidden: User \"system:node:ip-10-0-142-11.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-11.ec2.internal' and this object" podUID="37665713-b6dc-4b0d-8112-b6bbb0f98477" pod="opendatahub/test-curl-7791-139884325677792"
Jul 21 17:11:16.191145 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:16.191051    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37665713-b6dc-4b0d-8112-b6bbb0f98477" path="/var/lib/kubelet/pods/37665713-b6dc-4b0d-8112-b6bbb0f98477/volumes"
Jul 21 17:11:16.931895 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:16.931855    2577 generic.go:356] "Generic (PLEG): container finished" podID="a17a58a4-05c5-47c7-9f63-5ac655406231" containerID="85aff72d7510a8726c05774c26819512018e06906a99b6ba390b919c9dd4e484" exitCode=0
Jul 21 17:11:16.932055 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:16.931907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6" event={"ID":"a17a58a4-05c5-47c7-9f63-5ac655406231","Type":"ContainerDied","Data":"85aff72d7510a8726c05774c26819512018e06906a99b6ba390b919c9dd4e484"}
Jul 21 17:11:18.069642 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.069609    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:18.167008 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.166972    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17a58a4-05c5-47c7-9f63-5ac655406231-maas-api-service-ca\") pod \"a17a58a4-05c5-47c7-9f63-5ac655406231\" (UID: \"a17a58a4-05c5-47c7-9f63-5ac655406231\") "
Jul 21 17:11:18.167324 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.167301    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a17a58a4-05c5-47c7-9f63-5ac655406231-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a17a58a4-05c5-47c7-9f63-5ac655406231" (UID: "a17a58a4-05c5-47c7-9f63-5ac655406231"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:18.267619 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.267588    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a17a58a4-05c5-47c7-9f63-5ac655406231-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:18.943032 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.943002    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"
Jul 21 17:11:18.943250 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.942999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6" event={"ID":"a17a58a4-05c5-47c7-9f63-5ac655406231","Type":"ContainerDied","Data":"445b11f135ce598e30b8646cab657b770ace7386c9a5ccfc249288906e3a7b35"}
Jul 21 17:11:18.943250 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:18.943141    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="445b11f135ce598e30b8646cab657b770ace7386c9a5ccfc249288906e3a7b35"
Jul 21 17:11:28.990568 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:28.990493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:11:30.422674 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:30.422635    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"]
Jul 21 17:11:30.424614 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:30.424590    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-07bb43-6tmj6"]
Jul 21 17:11:32.189943 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:32.189909    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a17a58a4-05c5-47c7-9f63-5ac655406231" path="/var/lib/kubelet/pods/a17a58a4-05c5-47c7-9f63-5ac655406231/volumes"
Jul 21 17:11:37.524355 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.524315    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"]
Jul 21 17:11:37.524793 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.524629    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a17a58a4-05c5-47c7-9f63-5ac655406231" containerName="revoke-keys"
Jul 21 17:11:37.524793 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.524641    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a17a58a4-05c5-47c7-9f63-5ac655406231" containerName="revoke-keys"
Jul 21 17:11:37.524793 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.524706    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a17a58a4-05c5-47c7-9f63-5ac655406231" containerName="revoke-keys"
Jul 21 17:11:37.530168 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.530150    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:37.532339 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.532316    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 21 17:11:37.532984 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.532868    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zwrvn\""
Jul 21 17:11:37.535097 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.535069    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"]
Jul 21 17:11:37.631573 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.631541    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fe29d1-1788-4658-9737-c5236caa7471-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z\" (UID: \"22fe29d1-1788-4658-9737-c5236caa7471\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:37.733034 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.732996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fe29d1-1788-4658-9737-c5236caa7471-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z\" (UID: \"22fe29d1-1788-4658-9737-c5236caa7471\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:37.733659 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.733640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fe29d1-1788-4658-9737-c5236caa7471-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z\" (UID: \"22fe29d1-1788-4658-9737-c5236caa7471\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:37.842755 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.842728    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:37.969243 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:37.969204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"]
Jul 21 17:11:37.972274 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:11:37.972244    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fe29d1_1788_4658_9737_c5236caa7471.slice/crio-3490919bd732ec137fb13799d549694eb385af16494fb64053ef522b274d5e4f WatchSource:0}: Error finding container 3490919bd732ec137fb13799d549694eb385af16494fb64053ef522b274d5e4f: Status 404 returned error can't find the container with id 3490919bd732ec137fb13799d549694eb385af16494fb64053ef522b274d5e4f
Jul 21 17:11:38.026574 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:38.026547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z" event={"ID":"22fe29d1-1788-4658-9737-c5236caa7471","Type":"ContainerStarted","Data":"3490919bd732ec137fb13799d549694eb385af16494fb64053ef522b274d5e4f"}
Jul 21 17:11:39.032086 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:39.031992    2577 generic.go:356] "Generic (PLEG): container finished" podID="22fe29d1-1788-4658-9737-c5236caa7471" containerID="aa9030ef05caef4164c4e1c822dd2783422948140b8511c66b0d94a925cc8d18" exitCode=0
Jul 21 17:11:39.032086 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:39.032038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z" event={"ID":"22fe29d1-1788-4658-9737-c5236caa7471","Type":"ContainerDied","Data":"aa9030ef05caef4164c4e1c822dd2783422948140b8511c66b0d94a925cc8d18"}
Jul 21 17:11:40.163739 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:40.163715    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:40.254240 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:40.254208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fe29d1-1788-4658-9737-c5236caa7471-maas-api-service-ca\") pod \"22fe29d1-1788-4658-9737-c5236caa7471\" (UID: \"22fe29d1-1788-4658-9737-c5236caa7471\") "
Jul 21 17:11:40.254585 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:40.254554    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fe29d1-1788-4658-9737-c5236caa7471-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22fe29d1-1788-4658-9737-c5236caa7471" (UID: "22fe29d1-1788-4658-9737-c5236caa7471"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:11:40.355815 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:40.355788    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22fe29d1-1788-4658-9737-c5236caa7471-maas-api-service-ca\") on node \"ip-10-0-142-11.ec2.internal\" DevicePath \"\""
Jul 21 17:11:41.042202 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:41.042159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z" event={"ID":"22fe29d1-1788-4658-9737-c5236caa7471","Type":"ContainerDied","Data":"3490919bd732ec137fb13799d549694eb385af16494fb64053ef522b274d5e4f"}
Jul 21 17:11:41.042371 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:41.042244    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3490919bd732ec137fb13799d549694eb385af16494fb64053ef522b274d5e4f"
Jul 21 17:11:41.042371 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:41.042181    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"
Jul 21 17:11:50.695198 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:50.695152    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-cz97t"]
Jul 21 17:11:52.635612 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:52.635578    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"]
Jul 21 17:11:52.639371 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:52.639347    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-1e5534-mk64z"]
Jul 21 17:11:54.189869 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:11:54.189825    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fe29d1-1788-4658-9737-c5236caa7471" path="/var/lib/kubelet/pods/22fe29d1-1788-4658-9737-c5236caa7471/volumes"
Jul 21 17:12:05.780893 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:05.780856    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-5zp8r_526ff9e0-e7b8-4cfa-a06b-605c19909578/manager/0.log"
Jul 21 17:12:05.787761 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:05.787739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-5zp8r_526ff9e0-e7b8-4cfa-a06b-605c19909578/copy-manifests/0.log"
Jul 21 17:12:08.208984 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:08.208954    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x9mvp_7932aea6-a71b-4b6e-a1f5-fb7d3547b55e/kuadrant-console-plugin/0.log"
Jul 21 17:12:08.553610 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:08.553533    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cz97t_091d7e92-5072-4e7f-a36b-55284655847a/limitador/0.log"
Jul 21 17:12:09.254643 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:09.254612    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dcb5fbcb6-hvg2s_be8cd6f0-1bf6-4b68-bafa-841653d5a332/kube-auth-proxy/0.log"
Jul 21 17:12:10.387736 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:10.387699    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-krqmz_36ea25f0-a7a5-4f82-8201-46fe0758917e/main/0.log"
Jul 21 17:12:10.719409 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:10.719326    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-fxbkz_84eae28b-814b-4bda-b122-37d50b55a8be/main/0.log"
Jul 21 17:12:15.755596 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.755557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qc9mq/must-gather-c8p57"]
Jul 21 17:12:15.755975 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.755882    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fe29d1-1788-4658-9737-c5236caa7471" containerName="revoke-keys"
Jul 21 17:12:15.755975 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.755893    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fe29d1-1788-4658-9737-c5236caa7471" containerName="revoke-keys"
Jul 21 17:12:15.755975 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.755946    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fe29d1-1788-4658-9737-c5236caa7471" containerName="revoke-keys"
Jul 21 17:12:15.758925 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.758906    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:15.762354 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.762331    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qc9mq\"/\"default-dockercfg-652bc\""
Jul 21 17:12:15.762811 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.762787    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qc9mq\"/\"kube-root-ca.crt\""
Jul 21 17:12:15.762934 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.762798    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qc9mq\"/\"openshift-service-ca.crt\""
Jul 21 17:12:15.773731 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.773704    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qc9mq/must-gather-c8p57"]
Jul 21 17:12:15.864323 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.864293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/20096824-5dd8-4980-b7bd-43162fedef81-must-gather-output\") pod \"must-gather-c8p57\" (UID: \"20096824-5dd8-4980-b7bd-43162fedef81\") " pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:15.864506 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.864372    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwc4j\" (UniqueName: \"kubernetes.io/projected/20096824-5dd8-4980-b7bd-43162fedef81-kube-api-access-rwc4j\") pod \"must-gather-c8p57\" (UID: \"20096824-5dd8-4980-b7bd-43162fedef81\") " pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:15.965247 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.965205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/20096824-5dd8-4980-b7bd-43162fedef81-must-gather-output\") pod \"must-gather-c8p57\" (UID: \"20096824-5dd8-4980-b7bd-43162fedef81\") " pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:15.965412 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.965292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwc4j\" (UniqueName: \"kubernetes.io/projected/20096824-5dd8-4980-b7bd-43162fedef81-kube-api-access-rwc4j\") pod \"must-gather-c8p57\" (UID: \"20096824-5dd8-4980-b7bd-43162fedef81\") " pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:15.965530 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.965513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/20096824-5dd8-4980-b7bd-43162fedef81-must-gather-output\") pod \"must-gather-c8p57\" (UID: \"20096824-5dd8-4980-b7bd-43162fedef81\") " pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:15.973220 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:15.973195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwc4j\" (UniqueName: \"kubernetes.io/projected/20096824-5dd8-4980-b7bd-43162fedef81-kube-api-access-rwc4j\") pod \"must-gather-c8p57\" (UID: \"20096824-5dd8-4980-b7bd-43162fedef81\") " pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:16.068110 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:16.068019    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qc9mq/must-gather-c8p57"
Jul 21 17:12:16.198960 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:16.198923    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qc9mq/must-gather-c8p57"]
Jul 21 17:12:16.201475 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:12:16.201447    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20096824_5dd8_4980_b7bd_43162fedef81.slice/crio-e96ba4e51fb196ee51cad56e357535e4e7403a6b6397f3e25e80356041325076 WatchSource:0}: Error finding container e96ba4e51fb196ee51cad56e357535e4e7403a6b6397f3e25e80356041325076: Status 404 returned error can't find the container with id e96ba4e51fb196ee51cad56e357535e4e7403a6b6397f3e25e80356041325076
Jul 21 17:12:17.206828 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:17.206789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/must-gather-c8p57" event={"ID":"20096824-5dd8-4980-b7bd-43162fedef81","Type":"ContainerStarted","Data":"18a2813e17a9652cd2102eb6f76fb327cb200d2dad87deb60e09f3eb817896e0"}
Jul 21 17:12:17.207259 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:17.206845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/must-gather-c8p57" event={"ID":"20096824-5dd8-4980-b7bd-43162fedef81","Type":"ContainerStarted","Data":"e96ba4e51fb196ee51cad56e357535e4e7403a6b6397f3e25e80356041325076"}
Jul 21 17:12:18.215879 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:18.215834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/must-gather-c8p57" event={"ID":"20096824-5dd8-4980-b7bd-43162fedef81","Type":"ContainerStarted","Data":"15f758ffeedd739f66d167307301e7bb34400ae91c6eeb19ecded1e565c0170a"}
Jul 21 17:12:18.232739 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:18.232028    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qc9mq/must-gather-c8p57" podStartSLOduration=2.349766536 podStartE2EDuration="3.232007959s" totalImagesPullingTime="882.241423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:18.230691162 +0000 UTC m=+2834.571611025" watchObservedRunningTime="2026-07-21 17:12:18.232007959 +0000 UTC m=+2834.572927824"
Jul 21 17:12:18.764261 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:18.764231    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zj2d5_42c8fef1-c834-469a-8e1a-4dfde18f51c1/global-pull-secret-syncer/0.log"
Jul 21 17:12:18.862684 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:18.862655    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lxf94_3490ff45-587c-42be-9677-734c4a4f58c2/konnectivity-agent/0.log"
Jul 21 17:12:18.960396 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:18.960369    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-11.ec2.internal_75c2663eec2141df3d5c4f1c1932094d/haproxy/0.log"
Jul 21 17:12:24.562206 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:24.562100    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x9mvp_7932aea6-a71b-4b6e-a1f5-fb7d3547b55e/kuadrant-console-plugin/0.log"
Jul 21 17:12:24.842417 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:24.842331    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-cz97t_091d7e92-5072-4e7f-a36b-55284655847a/limitador/0.log"
Jul 21 17:12:26.690173 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.690115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/alertmanager/0.log"
Jul 21 17:12:26.715484 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.715439    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/config-reloader/0.log"
Jul 21 17:12:26.743388 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.743356    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/kube-rbac-proxy-web/0.log"
Jul 21 17:12:26.769878 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.769849    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/kube-rbac-proxy/0.log"
Jul 21 17:12:26.793337 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.793265    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/kube-rbac-proxy-metric/0.log"
Jul 21 17:12:26.824639 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.824592    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/prom-label-proxy/0.log"
Jul 21 17:12:26.846873 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:26.846848    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e3a5365f-4821-4d92-ba01-5b814791a6bc/init-config-reloader/0.log"
Jul 21 17:12:27.006037 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.005998    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6668948645-fslhr_63f88d3d-1e7b-438e-9558-6cf73f36722c/metrics-server/0.log"
Jul 21 17:12:27.146266 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.146203    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7srs_7db0c72b-4a7a-49a7-9221-fad874099419/node-exporter/0.log"
Jul 21 17:12:27.171605 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.171571    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7srs_7db0c72b-4a7a-49a7-9221-fad874099419/kube-rbac-proxy/0.log"
Jul 21 17:12:27.198070 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.198044    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d7srs_7db0c72b-4a7a-49a7-9221-fad874099419/init-textfile/0.log"
Jul 21 17:12:27.409298 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.409271    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/prometheus/0.log"
Jul 21 17:12:27.434511 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.434483    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/config-reloader/0.log"
Jul 21 17:12:27.462018 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.461990    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/thanos-sidecar/0.log"
Jul 21 17:12:27.486563 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.486522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/kube-rbac-proxy-web/0.log"
Jul 21 17:12:27.518071 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.518046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/kube-rbac-proxy/0.log"
Jul 21 17:12:27.543156 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.543105    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/kube-rbac-proxy-thanos/0.log"
Jul 21 17:12:27.569810 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:27.569774    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7910a975-fc1f-4a24-9044-f6cb6048e461/init-config-reloader/0.log"
Jul 21 17:12:28.621428 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.621388    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"]
Jul 21 17:12:28.627204 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.627172    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.630380 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.630349    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"]
Jul 21 17:12:28.812092 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.812036    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-sys\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.812309 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.812099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-proc\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.812309 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.812153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-lib-modules\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.812309 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.812221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-podres\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.812309 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.812272    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxxqw\" (UniqueName: \"kubernetes.io/projected/71be62da-6147-4017-ad46-fc3dd25761c5-kube-api-access-pxxqw\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913250 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxxqw\" (UniqueName: \"kubernetes.io/projected/71be62da-6147-4017-ad46-fc3dd25761c5-kube-api-access-pxxqw\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913417 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-sys\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913417 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-proc\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913417 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-lib-modules\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913591 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-podres\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913591 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913561    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-lib-modules\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913591 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-podres\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913779 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-proc\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.913779 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.913689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/71be62da-6147-4017-ad46-fc3dd25761c5-sys\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.926433 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.926398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxxqw\" (UniqueName: \"kubernetes.io/projected/71be62da-6147-4017-ad46-fc3dd25761c5-kube-api-access-pxxqw\") pod \"perf-node-gather-daemonset-lp4kx\" (UID: \"71be62da-6147-4017-ad46-fc3dd25761c5\") " pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:28.943365 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:28.943318    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:29.139506 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:29.139476    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"]
Jul 21 17:12:29.141831 ip-10-0-142-11 kubenswrapper[2577]: W0721 17:12:29.141797    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod71be62da_6147_4017_ad46_fc3dd25761c5.slice/crio-c95c4f311ef7eac21d0ecf523d96e7bf325609ca34eaaa9d3a3ec1324f36ef74 WatchSource:0}: Error finding container c95c4f311ef7eac21d0ecf523d96e7bf325609ca34eaaa9d3a3ec1324f36ef74: Status 404 returned error can't find the container with id c95c4f311ef7eac21d0ecf523d96e7bf325609ca34eaaa9d3a3ec1324f36ef74
Jul 21 17:12:29.299166 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:29.299131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx" event={"ID":"71be62da-6147-4017-ad46-fc3dd25761c5","Type":"ContainerStarted","Data":"9e6fb7b59a246046ed0c8172a4df7184054bfbc177ae44126d89472cfef46aee"}
Jul 21 17:12:29.299348 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:29.299193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx" event={"ID":"71be62da-6147-4017-ad46-fc3dd25761c5","Type":"ContainerStarted","Data":"c95c4f311ef7eac21d0ecf523d96e7bf325609ca34eaaa9d3a3ec1324f36ef74"}
Jul 21 17:12:29.299348 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:29.299222    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:29.316631 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:29.316568    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx" podStartSLOduration=1.316546856 podStartE2EDuration="1.316546856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:12:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:12:29.314515959 +0000 UTC m=+2845.655435826" watchObservedRunningTime="2026-07-21 17:12:29.316546856 +0000 UTC m=+2845.657466720"
Jul 21 17:12:31.959715 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:31.959669    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzhjt_7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b/dns/0.log"
Jul 21 17:12:31.981672 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:31.981635    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzhjt_7133b6a4-fa3f-4bc8-86c3-a38d04f8a32b/kube-rbac-proxy/0.log"
Jul 21 17:12:32.058581 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:32.058547    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z2fwz_b333731c-1774-409a-ab2a-871be05605f0/dns-node-resolver/0.log"
Jul 21 17:12:32.608638 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:32.608610    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6bbfff877f-pljhn_60392c6d-e5aa-4586-a53e-fc72e045b701/registry/0.log"
Jul 21 17:12:32.631429 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:32.631404    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fwpb4_e2a2dec2-d5bf-403b-befd-3d73a1b7bd30/node-ca/0.log"
Jul 21 17:12:33.743112 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:33.743084    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dcb5fbcb6-hvg2s_be8cd6f0-1bf6-4b68-bafa-841653d5a332/kube-auth-proxy/0.log"
Jul 21 17:12:34.630521 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:34.630474    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c56mx_2dd4b7ca-f2e3-4288-8c3b-1021e84e0c60/serve-healthcheck-canary/0.log"
Jul 21 17:12:35.263912 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:35.263880    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qzzv9_1dd0c780-6942-4888-8a62-31c132d0e662/kube-rbac-proxy/0.log"
Jul 21 17:12:35.286687 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:35.286660    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qzzv9_1dd0c780-6942-4888-8a62-31c132d0e662/exporter/0.log"
Jul 21 17:12:35.308792 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:35.308755    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qzzv9_1dd0c780-6942-4888-8a62-31c132d0e662/extractor/0.log"
Jul 21 17:12:35.314893 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:35.314866    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qc9mq/perf-node-gather-daemonset-lp4kx"
Jul 21 17:12:38.323436 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:38.323319    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-5zp8r_526ff9e0-e7b8-4cfa-a06b-605c19909578/manager/0.log"
Jul 21 17:12:38.349392 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:38.349358    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d658cff7b-5zp8r_526ff9e0-e7b8-4cfa-a06b-605c19909578/copy-manifests/0.log"
Jul 21 17:12:39.205372 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:39.205334    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dcb5fbcb6-hvg2s_be8cd6f0-1bf6-4b68-bafa-841653d5a332/kube-auth-proxy/0.log"
Jul 21 17:12:39.735940 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:39.735906    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76fbb8f576-pnsm6_177c2845-5675-47ae-a8a7-76c7fd3a2e36/manager/0.log"
Jul 21 17:12:40.731287 ip-10-0-142-11 kubenswrapper[2577]: I0721 17:12:40.731253    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dcb5fbcb6-hvg2s_be8cd6f0-1bf6-4b68-bafa-841653d5a332/kube-auth-proxy/0.log"