Jul 02 19:49:07.888209 ip-10-0-143-37 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 02 19:49:07.888226 ip-10-0-143-37 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 02 19:49:07.888236 ip-10-0-143-37 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 02 19:49:07.888578 ip-10-0-143-37 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 02 19:49:19.141948 ip-10-0-143-37 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 02 19:49:19.141970 ip-10-0-143-37 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ae4efd0f8031447f9638f587de49712a --
Jul 02 19:50:55.582189 ip-10-0-143-37 systemd[1]: Starting Kubernetes Kubelet...
Jul 02 19:50:55.988038 ip-10-0-143-37 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:50:55.988038 ip-10-0-143-37 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 02 19:50:55.988038 ip-10-0-143-37 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:50:55.988038 ip-10-0-143-37 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 02 19:50:55.988038 ip-10-0-143-37 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 02 19:50:55.988038 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.983014    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990198    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990212    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990216    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990219    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990223    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990225    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990230    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990233    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990235    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990238    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990241    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990243    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990246    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990249    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990252    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990254    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990259    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990266    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.003823 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990270    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990273    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990275    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990278    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990281    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990284    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990287    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990290    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990293    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990295    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990298    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990301    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990303    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990306    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990309    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990311    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990314    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990317    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990319    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990321    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.018792 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990324    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990326    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990329    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990332    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990335    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990337    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990340    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990342    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990345    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990347    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990350    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990352    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990355    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990358    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990361    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990363    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990366    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990368    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990371    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990373    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.020703 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990376    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990379    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990381    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990386    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990389    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990391    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990394    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990396    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990400    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990404    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990407    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990409    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990412    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990415    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990418    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990420    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990424    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990426    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990429    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990431    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.023056 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990434    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990436    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990439    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990441    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990444    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990447    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990449    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990452    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990454    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990457    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990459    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990461    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990464    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990467    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990469    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990472    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990475    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990477    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990480    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.038334 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990482    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.990484    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991174    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991180    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991183    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991185    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991188    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991191    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991193    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991196    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991198    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991201    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991207    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991210    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991214    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991217    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991220    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991222    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991225    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.040824 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991228    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991231    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991234    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991236    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991239    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991241    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991245    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991248    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991251    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991254    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991257    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991259    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991262    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991265    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991267    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991270    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991272    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991275    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991278    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991280    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.042664 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991283    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991286    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991288    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991291    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991293    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991296    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991299    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991301    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991303    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991307    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991312    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991315    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991317    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991320    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991323    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991325    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991328    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991330    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991333    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991337    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.044939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991340    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991343    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991345    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991348    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991350    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991354    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991357    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991360    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991363    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991365    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991368    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991370    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991373    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991375    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991377    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991380    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991383    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991385    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991387    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.058306 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991389    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.057198 ip-10-0-143-37 systemd[1]: Started Kubernetes Kubelet.
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991392    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991394    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991401    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991404    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991408    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991410    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991413    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991415    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991418    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991420    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991424    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991426    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991429    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991431    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991433    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991436    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991438    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991441    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991444    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.061054 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991446    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991448    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991451    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991862    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991869    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991892    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991898    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991903    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991906    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991909    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991912    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991915    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991917    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991920    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991923    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991928    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991930    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991934    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991937    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.132296 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991942    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991945    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991947    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991950    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991952    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991955    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991957    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991960    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991964    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991966    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991969    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991971    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991974    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991976    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991979    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991981    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991984    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991986    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991989    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991991    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.288282 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991994    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991996    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.991998    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992001    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992003    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992005    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992008    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992010    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992014    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992017    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992020    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992023    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992025    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992030    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992033    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992036    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992039    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992041    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992044    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.293230 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992047    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992050    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992052    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992055    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992058    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992060    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992064    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992067    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992069    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992071    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992074    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992076    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992079    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992082    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992084    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992087    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992089    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992092    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992094    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992097    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.293970 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992099    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992104    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992106    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992110    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992113    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992115    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992118    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992121    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992123    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992126    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992128    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992131    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992133    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992136    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992138    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992140    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992143    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992145    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992148    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992150    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.294561 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992152    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992155    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992157    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992159    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992222    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992229    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992236    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992240    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992244    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992247    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992252    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992256    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992259    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992263    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992266    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992271    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992274    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992276    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992279    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992282    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992285    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992288    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992293    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992295    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 02 19:50:56.295183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992298    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992301    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992304    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992308    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992311    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992314    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992317    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992320    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992323    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992326    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992329    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992332    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992336    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992339    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992341    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992344    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992347    2562 flags.go:64] FLAG: --enable-server="true"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992350    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992354    2562 flags.go:64] FLAG: --event-burst="100"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992357    2562 flags.go:64] FLAG: --event-qps="50"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992359    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992363    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992366    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992371    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 02 19:50:56.295924 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992374    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992377    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992380    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992383    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992386    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992389    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992392    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992395    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992398    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992400    2562 flags.go:64] FLAG: --feature-gates=""
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992404    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992407    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992410    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992413    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992416    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992418    2562 flags.go:64] FLAG: --help="false"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992421    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992424    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992427    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992429    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992433    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992436    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992438    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 02 19:50:56.296621 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992441    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992444    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992447    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992449    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992452    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992455    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992459    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992462    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992466    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992469    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992472    2562 flags.go:64] FLAG: --lock-file=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992474    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992477    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992480    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992485    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992488    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992491    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992493    2562 flags.go:64] FLAG: --logging-format="text"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992496    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992499    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992502    2562 flags.go:64] FLAG: --manifest-url=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992505    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992509    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992511    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992515    2562 flags.go:64] FLAG: --max-pods="110"
Jul 02 19:50:56.297379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992518    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992521    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992523    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992526    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992529    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992532    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992535    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992542    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992545    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992548    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992550    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992553    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992559    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992562    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992567    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992571    2562 flags.go:64] FLAG: --port="10250"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992574    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992577    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03e71b168d642a565"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992580    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992582    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992585    2562 flags.go:64] FLAG: --register-node="true"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992588    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992592    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992595    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 02 19:50:56.298203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992598    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992601    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992605    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992608    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992611    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992614    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992616    2562 flags.go:64] FLAG: --runonce="false"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992619    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992623    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992625    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992628    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992631    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992634    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992637    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992639    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992642    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992644    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992647    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992650    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992653    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992655    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992658    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992665    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992669    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992672    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 02 19:50:56.298887 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992676    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992679    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992681    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992684    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992687    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992690    2562 flags.go:64] FLAG: --v="2"
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992694    2562 flags.go:64] FLAG: --version="false"
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992699    2562 flags.go:64] FLAG: --vmodule=""
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992702    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.992706    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992817    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992820    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992823    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992826    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992829    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992831    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992834    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992836    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992840    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992857    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992860    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.299601 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992862    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992865    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992868    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992870    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992888    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992890    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992893    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992895    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992900    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992906    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992927    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992931    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992934    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992936    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992939    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992942    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992944    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992947    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992950    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.300166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992954    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992956    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992959    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992962    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992964    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992967    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992969    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992972    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992974    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992977    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992979    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992982    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992984    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992987    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992989    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992991    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992994    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992997    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.992999    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993001    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.300688 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993004    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993009    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993013    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993016    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993019    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993021    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993024    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993026    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993029    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993031    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993034    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993036    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993039    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993042    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993044    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993047    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993049    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993052    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993055    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993057    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.303440 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993059    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993062    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993064    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993067    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993069    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993071    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993074    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993076    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993079    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993081    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993084    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993086    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993089    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993093    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993096    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993099    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993101    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993104    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993107    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993109    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.304062 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993113    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993117    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993120    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993123    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993126    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993129    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993132    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993135    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:55.993138    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:55.993797    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.000570    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.000587    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.000606    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.000612    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 02 19:50:56.304749 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000667    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000672    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000677    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000680    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000683    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000686    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000689    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000691    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000694    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000697    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000700    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000702    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000705    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000707    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000710    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000713    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000716    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000719    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000721    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.306502 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000724    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000726    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000729    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000732    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000735    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000738    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000741    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000744    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000746    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000748    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000752    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000754    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000756    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000759    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000761    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000764    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000766    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000768    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000776    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000778    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.308214 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000781    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000783    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000786    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000789    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000791    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000794    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000797    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000799    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000802    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000804    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000807    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000809    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000812    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000814    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000817    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000819    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000822    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000824    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000828    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000831    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.309211 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000834    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000836    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000839    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000842    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000856    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000863    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000867    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000871    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000908    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000911    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000916    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000919    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000921    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000924    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000926    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000929    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000932    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000934    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000937    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.310887 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000940    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000942    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000945    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000948    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000952    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000955    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000959    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000961    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000964    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000967    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000969    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000977    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000981    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000985    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000989    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000992    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.000997    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001002    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001006    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001010    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.313270 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001013    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.001020    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001175    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001182    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001187    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001192    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001196    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001200    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001204    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001211    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001216    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001220    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001224    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001227    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 02 19:50:56.323549 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001231    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001234    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001238    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001241    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001245    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001249    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001253    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001256    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001260    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001266    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001270    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001274    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001277    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001281    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001285    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001288    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001293    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001296    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001300    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001303    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 02 19:50:56.422031 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001306    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001310    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001315    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001319    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001323    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001327    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001331    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001337    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001342    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001346    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001351    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001355    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001359    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001363    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001367    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001371    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001374    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001377    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001379    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001383    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 02 19:50:56.423511 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001386    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001391    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001395    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001399    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001403    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001407    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001411    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001414    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001418    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001423    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001426    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001430    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001434    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001437    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001442    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001446    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001449    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001453    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001457    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001461    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 02 19:50:56.424174 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001464    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001468    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001472    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001475    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001479    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001483    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001486    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001490    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001494    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001497    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001501    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001505    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001509    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001514    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001518    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001522    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001525    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001529    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001532    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001536    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 02 19:50:56.424693 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001540    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001543    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001549    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001554    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001557    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001561    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:56.001567    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.001574    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.001706    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.004028    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.005434    2562 server.go:1019] "Starting client certificate rotation"
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.005538    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.006280    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 02 19:50:56.425357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.007842    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.013374    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.023401    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.027082    2562 log.go:25] "Validated CRI v1 image API"
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.027942    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.030551    2562 fs.go:135] Filesystem UUIDs: map[77b987a9-7d7c-4133-8cac-a0dde1577a8c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 dec5e2b9-18bd-4279-8311-b97ba9c3f712:/dev/nvme0n1p3]
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.030571    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 02 19:50:56.425743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.034415    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.035784    2562 manager.go:216] Machine: {Timestamp:2026-07-02 19:50:56.034472601 +0000 UTC m=+0.329355103 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3138510 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec247fb74d7ac4c3b74662bef6ee5cb7 SystemUUID:ec247fb7-4d7a-c4c3-b746-62bef6ee5cb7 BootID:ae4efd0f-8031-447f-9638-f587de49712a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:3d:50:36:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:3d:50:36:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:26:01:13:93:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.035909    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.036046    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.039247    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.039275    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-37.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.039977    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.039987    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.039995    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.040813    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.042149    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045246    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045382    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045417    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045432    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045466    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045479    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045487    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 02 19:50:56.426066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045922    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.045944    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.048545    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.050577    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.050606    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051656    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051669    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051675    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051680    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051688    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051694    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051702    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051707    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051717    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051723    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051731    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.051736    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.052497    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.052506    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.055758    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.055949    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-37.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.055970    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.056226    2562 server.go:1268] "Started kubelet"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.056279    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.056842    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.061221    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.062452    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.063126    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.063845    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-thcb5"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.064742    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.066951    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-37.ec2.internal.18be90ee64fc817a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-37.ec2.internal,UID:ip-10-0-143-37.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-37.ec2.internal,},FirstTimestamp:2026-07-02 19:50:56.056181114 +0000 UTC m=+0.351063619,LastTimestamp:2026-07-02 19:50:56.056181114 +0000 UTC m=+0.351063619,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-37.ec2.internal,}"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.068637    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.068653    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.068715    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069306    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069324    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069309    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069411    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069420    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069534    2562 factory.go:55] Registering systemd factory
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069552    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 02 19:50:56.426670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069755    2562 factory.go:153] Registering CRI-O factory
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069771    2562 factory.go:223] Registration of the crio container factory successfully
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069837    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069863    2562 factory.go:103] Registering Raw factory
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.069896    2562 manager.go:1196] Started watching for new ooms in manager
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.070254    2562 manager.go:349] Starting recovery of all containers
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.073733    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-thcb5"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.078176    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.078282    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-37.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.079729    2562 manager.go:354] Recovery completed
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.084174    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.085858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.085903    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.085915    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.086465    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.086485    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.086502    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.086474    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.087102    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.087127    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.087138    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.087525    2562 policy_none.go:49] "None policy: Start"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.087539    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.087551    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.088542    2562 policy_none.go:47] "Start"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.156606    2562 manager.go:337] "Starting Device Plugin manager"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.156661    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.156675    2562 server.go:87] "Starting device plugin registration server"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.157020    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.157030    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.157220    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.157277    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.157282    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.157847    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.157911    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.256420    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.257635    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.257647    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.257699    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.257730    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.257776    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.258685    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.258722    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.258738    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.258770    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.260540    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:56.427762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.270102    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.270126    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-37.ec2.internal\": node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.293065    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.358102    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"]
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.358202    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.359827    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.359858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.359869    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361141    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361293    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361322    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361890    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361943    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361959    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.361890    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.362006    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.362015    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.363116    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.363137    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.363834    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientMemory"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.363859    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasNoDiskPressure"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.363868    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeHasSufficientPID"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.370383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea1ee2087c460df8e4c2dc1d21fd4480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"ea1ee2087c460df8e4c2dc1d21fd4480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.370410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1ee2087c460df8e4c2dc1d21fd4480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"ea1ee2087c460df8e4c2dc1d21fd4480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.370433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e830bc32dc0970f441a153655ff8620-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"0e830bc32dc0970f441a153655ff8620\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.393597    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.406168    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.429008 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.411697    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-37.ec2.internal\" not found" node="ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.470523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e830bc32dc0970f441a153655ff8620-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"0e830bc32dc0970f441a153655ff8620\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.470551    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea1ee2087c460df8e4c2dc1d21fd4480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"ea1ee2087c460df8e4c2dc1d21fd4480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.470567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1ee2087c460df8e4c2dc1d21fd4480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"ea1ee2087c460df8e4c2dc1d21fd4480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.470621    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea1ee2087c460df8e4c2dc1d21fd4480-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"ea1ee2087c460df8e4c2dc1d21fd4480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.470626    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0e830bc32dc0970f441a153655ff8620-config\") pod \"kube-apiserver-proxy-ip-10-0-143-37.ec2.internal\" (UID: \"0e830bc32dc0970f441a153655ff8620\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.470647    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ea1ee2087c460df8e4c2dc1d21fd4480-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal\" (UID: \"ea1ee2087c460df8e4c2dc1d21fd4480\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.552767 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.494315    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.662402 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.594567    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.805706 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.695072    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.805706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.709216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.805706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:56.714782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:56.805706 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.795729    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:56.955118 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.898134    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:57.064196 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:56.999319    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:57.064196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.004917    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 02 19:50:57.064196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.005077    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 02 19:50:57.191247 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.078057    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:45:56 +0000 UTC" deadline="2028-01-15 10:25:22.038737688 +0000 UTC"
Jul 02 19:50:57.191247 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.078111    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13478h34m24.960631761s"
Jul 02 19:50:57.191247 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:57.099682    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:57.195391 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.192362    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:57.339763 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:57.199935    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:57.339763 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.289203    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:57.339763 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:57.300662    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-37.ec2.internal\" not found"
Jul 02 19:50:57.477917 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.389336    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:57.477917 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:57.389992    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea1ee2087c460df8e4c2dc1d21fd4480.slice/crio-6cc277b628f4fe26a7f5bb4c6ddabf4e8904233cfe7749764700a35dabab4638 WatchSource:0}: Error finding container 6cc277b628f4fe26a7f5bb4c6ddabf4e8904233cfe7749764700a35dabab4638: Status 404 returned error can't find the container with id 6cc277b628f4fe26a7f5bb4c6ddabf4e8904233cfe7749764700a35dabab4638
Jul 02 19:50:57.477917 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:57.390412    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e830bc32dc0970f441a153655ff8620.slice/crio-2220110a6346e9307029588f70f23e3444cd1aabd5a11a30291cd96c065756eb WatchSource:0}: Error finding container 2220110a6346e9307029588f70f23e3444cd1aabd5a11a30291cd96c065756eb: Status 404 returned error can't find the container with id 2220110a6346e9307029588f70f23e3444cd1aabd5a11a30291cd96c065756eb
Jul 02 19:50:57.477917 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.394943    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:50:57.477917 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.469170    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:57.664913 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.482233    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:50:57.664913 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.483539    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal"
Jul 02 19:50:57.664913 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.493334    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 02 19:50:58.018181 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:57.955061    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.048129    2562 apiserver.go:52] "Watching apiserver"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.058655    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.059233    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-ztxwh","kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf","openshift-cluster-node-tuning-operator/tuned-smftc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal","openshift-multus/multus-6lj5l","openshift-multus/multus-additional-cni-plugins-6mz57","openshift-network-diagnostics/network-check-target-d4khc","kube-system/global-pull-secret-syncer-7j2wv","openshift-dns/node-resolver-lsm22","openshift-image-registry/node-ca-fcjwf","openshift-multus/network-metrics-daemon-7vbkc","openshift-network-operator/iptables-alerter-qs4br","openshift-ovn-kubernetes/ovnkube-node-9tm24"]
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.061119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.062646    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.063988    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.065997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.067730    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.069335    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.069855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.073940    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.074027    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.074778    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.076303    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.076381    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.078541    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.079935    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.081531    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.081641    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl2ht\" (UniqueName: \"kubernetes.io/projected/789a4b31-a62b-46cf-b64c-48a57fbedaac-kube-api-access-hl2ht\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjzf6\" (UniqueName: \"kubernetes.io/projected/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-kube-api-access-zjzf6\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.103296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-sys\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4js2\" (UniqueName: \"kubernetes.io/projected/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-kube-api-access-c4js2\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-hostroot\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-conf-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089736    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-systemd\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-cni-bin\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8hdq\" (UniqueName: \"kubernetes.io/projected/8e55f232-5890-4ccb-80ce-8d7a63893da2-kube-api-access-x8hdq\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089810    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-socket-dir-parent\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-netns\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-daemon-config\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-dbus\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-socket-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.089976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-systemd\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090004    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-var-lib-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovnkube-config\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-env-overrides\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-cnibin\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.107183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-os-release\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-sys-fs\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-tmp\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-system-cni-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-modprobe-d\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090306    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-kubernetes\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-run\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-kubelet\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-systemd-units\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090807    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d48c2\" (UniqueName: \"kubernetes.io/projected/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-kube-api-access-d48c2\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090877    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/789a4b31-a62b-46cf-b64c-48a57fbedaac-host\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/789a4b31-a62b-46cf-b64c-48a57fbedaac-serviceca\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-host\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.090973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-etc-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.108501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovnkube-script-lib\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-kubelet-config\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091065    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovn-node-metrics-cert\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091149    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-system-cni-dir\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-tuned\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-slash\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091228    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-run-netns\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-device-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-var-lib-kubelet\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-node-log\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-log-socket\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-cni-netd\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-etc-kubernetes\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-cni-binary-copy\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.112706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091476    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysctl-conf\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091502    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-kubelet\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-ovn\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-cni-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-os-release\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-cni-bin\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysconfig\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-cni-binary-copy\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-lib-modules\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-cni-multus\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-registration-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-multus-certs\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-cnibin\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysctl-d\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.114031 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-k8s-cni-cncf-io\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.091932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q7fw\" (UniqueName: \"kubernetes.io/projected/da700b65-1646-4596-95d4-4d635686f180-kube-api-access-4q7fw\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.102275    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.102405    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.102404    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.102668    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.102748    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mxl6d\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.102672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.103072    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.104715    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.104921    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gspwc\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.105210    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.105355    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.105534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5l9v8\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.105701    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.105875    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.106058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qsq7c\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.106214    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.106421    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 02 19:50:58.114989 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.106576    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.189745 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.170761    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 02 19:50:58.189745 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.178835    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.189745 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.179285    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.189745 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.179486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 02 19:50:58.189745 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.181662    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.192770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-cni-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.192821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-os-release\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.192891    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-cni-bin\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.192924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysconfig\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.192956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-cni-binary-copy\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.192990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-lib-modules\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-cni-multus\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193058    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23c9debd-909e-4b72-8963-a656e42f1b8b-konnectivity-ca\") pod \"konnectivity-agent-ztxwh\" (UID: \"23c9debd-909e-4b72-8963-a656e42f1b8b\") " pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-registration-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-multus-certs\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-cnibin\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.194791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-registration-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.194806    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-cni-multus\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.194850    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-cni-bin\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.194921    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-os-release\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.194986    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysconfig\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.302231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.195085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-cni-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.303692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.195110    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-lib-modules\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.303692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.195158    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-cnibin\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.303692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.195268    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-run-ovn-kubernetes\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.303692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.195763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-cni-binary-copy\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.342294 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.195046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-multus-certs\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.342700 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.193222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e52320f-3017-4db1-a6cc-43e306297148-tmp-dir\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.342813 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.342747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysctl-d\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.342813 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.342802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-k8s-cni-cncf-io\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.342922 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.342840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q7fw\" (UniqueName: \"kubernetes.io/projected/da700b65-1646-4596-95d4-4d635686f180-kube-api-access-4q7fw\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.342922 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.342884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm8kz\" (UniqueName: \"kubernetes.io/projected/1e52320f-3017-4db1-a6cc-43e306297148-kube-api-access-pm8kz\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.343060 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.342924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw82h\" (UniqueName: \"kubernetes.io/projected/827191eb-bb3b-4112-97dc-fe9b593d14f4-kube-api-access-zw82h\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.343060 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.342973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.343060 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx4m4\" (UniqueName: \"kubernetes.io/projected/ae816d1e-f53b-43a4-a553-cc5651a184b2-kube-api-access-jx4m4\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.343060 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl2ht\" (UniqueName: \"kubernetes.io/projected/789a4b31-a62b-46cf-b64c-48a57fbedaac-kube-api-access-hl2ht\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.343269 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.343269 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343098    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-np9vf\""
Jul 02 19:50:58.343382 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjzf6\" (UniqueName: \"kubernetes.io/projected/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-kube-api-access-zjzf6\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.343382 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343328    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-sys\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.343382 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4js2\" (UniqueName: \"kubernetes.io/projected/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-kube-api-access-c4js2\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.343522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343398    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-hostroot\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.343522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-conf-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.343522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-k8s-cni-cncf-io\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.343522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343461    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-systemd\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.343522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343473    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysctl-d\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.343522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-cni-bin\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8hdq\" (UniqueName: \"kubernetes.io/projected/8e55f232-5890-4ccb-80ce-8d7a63893da2-kube-api-access-x8hdq\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343559    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-socket-dir-parent\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sk9ql\""
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-netns\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343666    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-daemon-config\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-dbus\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-socket-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-systemd\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.343814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343792    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-var-lib-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovnkube-config\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-env-overrides\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343525    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-cnibin\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-os-release\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.343995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-sys-fs\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344038    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rqrf7\""
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-tmp\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-system-cni-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/827191eb-bb3b-4112-97dc-fe9b593d14f4-host-slash\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-sys\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-modprobe-d\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-kubernetes\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344248    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-run\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.344285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344286    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344319    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-hostroot\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-socket-dir-parent\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-cni-bin\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344415    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-run\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344438    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-systemd\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-run-netns\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-cnibin\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-os-release\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2k4tn\""
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344779    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-conf-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-kubelet\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/827191eb-bb3b-4112-97dc-fe9b593d14f4-iptables-alerter-script\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.344992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-systemd-units\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d48c2\" (UniqueName: \"kubernetes.io/projected/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-kube-api-access-d48c2\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:50:58.345155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.345922 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/789a4b31-a62b-46cf-b64c-48a57fbedaac-host\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.345922 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/789a4b31-a62b-46cf-b64c-48a57fbedaac-serviceca\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.346030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.345941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-host\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.347097 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.346033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-etc-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347212 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovnkube-script-lib\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347212 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-kubelet-config\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.347212 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.347373 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347373 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347280    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovn-node-metrics-cert\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347373 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-system-cni-dir\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.347373 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e52320f-3017-4db1-a6cc-43e306297148-hosts-file\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.347559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-tuned\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.347559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-slash\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-run-netns\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23c9debd-909e-4b72-8963-a656e42f1b8b-agent-certs\") pod \"konnectivity-agent-ztxwh\" (UID: \"23c9debd-909e-4b72-8963-a656e42f1b8b\") " pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.347559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347514    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-device-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.347559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-var-lib-kubelet\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-node-log\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347616    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-log-socket\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-cni-netd\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-etc-kubernetes\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-cni-binary-copy\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysctl-conf\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.347840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-kubelet\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.348371 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.347846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-ovn\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.353113 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-sys-fs\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.353306 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.353284    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.353414 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353396    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-log-socket\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.354102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.354102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-system-cni-dir\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.354102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353722    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.354102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-modprobe-d\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.354102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353788    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-dbus\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.354102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.353870    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-kubernetes\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.354626 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.354603    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-systemd\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.354626 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.354614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.354756 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.354662    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-var-lib-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.354821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.354800    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/789a4b31-a62b-46cf-b64c-48a57fbedaac-host\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.355033 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.354976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-host-var-lib-kubelet\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.355229 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.355209    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 02 19:50:58.355330 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.355311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-systemd-units\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.355392 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.355338    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 02 19:50:58.355450 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.355388    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 02 19:50:58.355598 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.355574    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-socket-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.355789 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.355757    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vhlnz\""
Jul 02 19:50:58.356054 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/789a4b31-a62b-46cf-b64c-48a57fbedaac-serviceca\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.356138 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356120    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.356189 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-run-ovn\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.356189 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356174    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-etc-openvswitch\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.356302 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.355066    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:58.855040611 +0000 UTC m=+3.149923109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.356302 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-kubelet-config\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.356302 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-host\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.356470 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356326    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356692    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-env-overrides\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-slash\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356732    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-run-netns\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356796    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-device-dir\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-var-lib-kubelet\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356901    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356920    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-node-log\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.356985    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-cni-netd\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357034    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-etc-kubernetes\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357081    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 02 19:50:58.357199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8e55f232-5890-4ccb-80ce-8d7a63893da2-host-kubelet\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.357675 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/da700b65-1646-4596-95d4-4d635686f180-system-cni-dir\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.357675 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357391    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 02 19:50:58.357675 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357611    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/da700b65-1646-4596-95d4-4d635686f180-cni-binary-copy\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.357825 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.357807    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-multus-daemon-config\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.359127 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.358000    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-sysctl-conf\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.359127 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.358293    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 02 19:50:58.362368 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.362198    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-tmp\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.363219 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.362550    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q7fw\" (UniqueName: \"kubernetes.io/projected/da700b65-1646-4596-95d4-4d635686f180-kube-api-access-4q7fw\") pod \"multus-additional-cni-plugins-6mz57\" (UID: \"da700b65-1646-4596-95d4-4d635686f180\") " pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.363219 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.362812    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-etc-tuned\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.363219 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.363017    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjzf6\" (UniqueName: \"kubernetes.io/projected/252c8b1e-10ab-4aee-80f4-f1f1f404e20c-kube-api-access-zjzf6\") pod \"aws-ebs-csi-driver-node-7l2vf\" (UID: \"252c8b1e-10ab-4aee-80f4-f1f1f404e20c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.363219 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.363130    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl2ht\" (UniqueName: \"kubernetes.io/projected/789a4b31-a62b-46cf-b64c-48a57fbedaac-kube-api-access-hl2ht\") pod \"node-ca-fcjwf\" (UID: \"789a4b31-a62b-46cf-b64c-48a57fbedaac\") " pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.364496 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.364470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovn-node-metrics-cert\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.365082 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.364973    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"ea1ee2087c460df8e4c2dc1d21fd4480","Type":"ContainerStarted","Data":"6cc277b628f4fe26a7f5bb4c6ddabf4e8904233cfe7749764700a35dabab4638"}
Jul 02 19:50:58.366721 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.366551    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovnkube-config\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.367417 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.367331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" event={"ID":"0e830bc32dc0970f441a153655ff8620","Type":"ContainerStarted","Data":"2220110a6346e9307029588f70f23e3444cd1aabd5a11a30291cd96c065756eb"}
Jul 02 19:50:58.368394 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.367538    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8hdq\" (UniqueName: \"kubernetes.io/projected/8e55f232-5890-4ccb-80ce-8d7a63893da2-kube-api-access-x8hdq\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.368394 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.367598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8e55f232-5890-4ccb-80ce-8d7a63893da2-ovnkube-script-lib\") pod \"ovnkube-node-9tm24\" (UID: \"8e55f232-5890-4ccb-80ce-8d7a63893da2\") " pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.372371 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.372336    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4js2\" (UniqueName: \"kubernetes.io/projected/6cd1f8e4-93fd-4a05-b34a-bd0132828dbf-kube-api-access-c4js2\") pod \"tuned-smftc\" (UID: \"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf\") " pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.373283 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.373030    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 02 19:50:58.373283 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.373243    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hs6qg"
Jul 02 19:50:58.374179 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.374116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d48c2\" (UniqueName: \"kubernetes.io/projected/bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b-kube-api-access-d48c2\") pod \"multus-6lj5l\" (UID: \"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b\") " pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.381122 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.380776    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6mz57"
Jul 02 19:50:58.390901 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.389931    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda700b65_1646_4596_95d4_4d635686f180.slice/crio-795d6349ab92a05fb3f3d75625cc862ba67bed5770a777064622a54d393cc126 WatchSource:0}: Error finding container 795d6349ab92a05fb3f3d75625cc862ba67bed5770a777064622a54d393cc126: Status 404 returned error can't find the container with id 795d6349ab92a05fb3f3d75625cc862ba67bed5770a777064622a54d393cc126
Jul 02 19:50:58.394359 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.394127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fcjwf"
Jul 02 19:50:58.403158 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.403001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf"
Jul 02 19:50:58.403939 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.403906    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod789a4b31_a62b_46cf_b64c_48a57fbedaac.slice/crio-59cc9d8db0487d6ac948f2a643897fa5ef64e8fa66600bf43bae1f06813dce69 WatchSource:0}: Error finding container 59cc9d8db0487d6ac948f2a643897fa5ef64e8fa66600bf43bae1f06813dce69: Status 404 returned error can't find the container with id 59cc9d8db0487d6ac948f2a643897fa5ef64e8fa66600bf43bae1f06813dce69
Jul 02 19:50:58.412757 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.412729    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod252c8b1e_10ab_4aee_80f4_f1f1f404e20c.slice/crio-07cd4cf3f049b94677b3e2cbccdbb42452d6d7286643904f1ddff7686585b3e4 WatchSource:0}: Error finding container 07cd4cf3f049b94677b3e2cbccdbb42452d6d7286643904f1ddff7686585b3e4: Status 404 returned error can't find the container with id 07cd4cf3f049b94677b3e2cbccdbb42452d6d7286643904f1ddff7686585b3e4
Jul 02 19:50:58.413682 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.413660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smftc"
Jul 02 19:50:58.422779 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.422719    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:50:58.423653 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.423630    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd1f8e4_93fd_4a05_b34a_bd0132828dbf.slice/crio-70dbb65906520070b49e24b6b6dfaeddd79d4646627cf339acee0970b5f5247b WatchSource:0}: Error finding container 70dbb65906520070b49e24b6b6dfaeddd79d4646627cf339acee0970b5f5247b: Status 404 returned error can't find the container with id 70dbb65906520070b49e24b6b6dfaeddd79d4646627cf339acee0970b5f5247b
Jul 02 19:50:58.431873 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.431852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6lj5l"
Jul 02 19:50:58.432252 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.432224    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e55f232_5890_4ccb_80ce_8d7a63893da2.slice/crio-1f82daa07a80fdc56361af3c347d944420c30fc3d4b2ce93d1f69c12f7cc94b7 WatchSource:0}: Error finding container 1f82daa07a80fdc56361af3c347d944420c30fc3d4b2ce93d1f69c12f7cc94b7: Status 404 returned error can't find the container with id 1f82daa07a80fdc56361af3c347d944420c30fc3d4b2ce93d1f69c12f7cc94b7
Jul 02 19:50:58.442075 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.442020    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc8fd3be_7fd7_468f_80da_e8e62e9d8a7b.slice/crio-0c172122e9747d2e1c0b33b4f33daf1da63c2a7328dacffb37a8fc1b614c3ca9 WatchSource:0}: Error finding container 0c172122e9747d2e1c0b33b4f33daf1da63c2a7328dacffb37a8fc1b614c3ca9: Status 404 returned error can't find the container with id 0c172122e9747d2e1c0b33b4f33daf1da63c2a7328dacffb37a8fc1b614c3ca9
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.448768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e52320f-3017-4db1-a6cc-43e306297148-hosts-file\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.448805    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23c9debd-909e-4b72-8963-a656e42f1b8b-agent-certs\") pod \"konnectivity-agent-ztxwh\" (UID: \"23c9debd-909e-4b72-8963-a656e42f1b8b\") " pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.448843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23c9debd-909e-4b72-8963-a656e42f1b8b-konnectivity-ca\") pod \"konnectivity-agent-ztxwh\" (UID: \"23c9debd-909e-4b72-8963-a656e42f1b8b\") " pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.448876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e52320f-3017-4db1-a6cc-43e306297148-tmp-dir\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.448935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm8kz\" (UniqueName: \"kubernetes.io/projected/1e52320f-3017-4db1-a6cc-43e306297148-kube-api-access-pm8kz\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.448980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw82h\" (UniqueName: \"kubernetes.io/projected/827191eb-bb3b-4112-97dc-fe9b593d14f4-kube-api-access-zw82h\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx4m4\" (UniqueName: \"kubernetes.io/projected/ae816d1e-f53b-43a4-a553-cc5651a184b2-kube-api-access-jx4m4\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/827191eb-bb3b-4112-97dc-fe9b593d14f4-host-slash\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/827191eb-bb3b-4112-97dc-fe9b593d14f4-iptables-alerter-script\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:50:58.449303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.449919 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.449343    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.449919 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.449401    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:58.949381223 +0000 UTC m=+3.244263720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.449919 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449569    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e52320f-3017-4db1-a6cc-43e306297148-hosts-file\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.449919 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449770    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e52320f-3017-4db1-a6cc-43e306297148-tmp-dir\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.449919 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.449822    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/827191eb-bb3b-4112-97dc-fe9b593d14f4-host-slash\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.450348 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.450325    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23c9debd-909e-4b72-8963-a656e42f1b8b-konnectivity-ca\") pod \"konnectivity-agent-ztxwh\" (UID: \"23c9debd-909e-4b72-8963-a656e42f1b8b\") " pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.450526 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.450501    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/827191eb-bb3b-4112-97dc-fe9b593d14f4-iptables-alerter-script\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.454867 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.454809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23c9debd-909e-4b72-8963-a656e42f1b8b-agent-certs\") pod \"konnectivity-agent-ztxwh\" (UID: \"23c9debd-909e-4b72-8963-a656e42f1b8b\") " pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.461409 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.461378    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:50:58.461409 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.461413    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:50:58.461626 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.461432    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:58.461626 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.461506    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:50:58.961482607 +0000 UTC m=+3.256365115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:58.464341 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.464277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm8kz\" (UniqueName: \"kubernetes.io/projected/1e52320f-3017-4db1-a6cc-43e306297148-kube-api-access-pm8kz\") pod \"node-resolver-lsm22\" (UID: \"1e52320f-3017-4db1-a6cc-43e306297148\") " pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.465251 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.465218    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx4m4\" (UniqueName: \"kubernetes.io/projected/ae816d1e-f53b-43a4-a553-cc5651a184b2-kube-api-access-jx4m4\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.466020 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.465972    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw82h\" (UniqueName: \"kubernetes.io/projected/827191eb-bb3b-4112-97dc-fe9b593d14f4-kube-api-access-zw82h\") pod \"iptables-alerter-qs4br\" (UID: \"827191eb-bb3b-4112-97dc-fe9b593d14f4\") " pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.476082 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.476047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qs4br"
Jul 02 19:50:58.491452 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.491412    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827191eb_bb3b_4112_97dc_fe9b593d14f4.slice/crio-ed76061b942d853619f62a1a6e8a46af05cf5ae0439b80983365b9e6f01aa1af WatchSource:0}: Error finding container ed76061b942d853619f62a1a6e8a46af05cf5ae0439b80983365b9e6f01aa1af: Status 404 returned error can't find the container with id ed76061b942d853619f62a1a6e8a46af05cf5ae0439b80983365b9e6f01aa1af
Jul 02 19:50:58.532756 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.532688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsm22"
Jul 02 19:50:58.542766 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.542733    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e52320f_3017_4db1_a6cc_43e306297148.slice/crio-022604440f7af314ea670d54d18fd653a86536d7d1b34bcc52158a2965279df8 WatchSource:0}: Error finding container 022604440f7af314ea670d54d18fd653a86536d7d1b34bcc52158a2965279df8: Status 404 returned error can't find the container with id 022604440f7af314ea670d54d18fd653a86536d7d1b34bcc52158a2965279df8
Jul 02 19:50:58.649663 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.649632    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:50:58.659745 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:50:58.659709    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c9debd_909e_4b72_8963_a656e42f1b8b.slice/crio-cde1c2c2b62f2a4be4570f0ec5037c2724af1a0ae706cfca6ea041412dd9213c WatchSource:0}: Error finding container cde1c2c2b62f2a4be4570f0ec5037c2724af1a0ae706cfca6ea041412dd9213c: Status 404 returned error can't find the container with id cde1c2c2b62f2a4be4570f0ec5037c2724af1a0ae706cfca6ea041412dd9213c
Jul 02 19:50:58.952798 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.952758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:58.952798 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:58.952799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:58.953054 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.952918    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.953054 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.952994    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:59.952972926 +0000 UTC m=+4.247855432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:58.953054 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.952918    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:58.953054 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:58.953039    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:50:59.953026594 +0000 UTC m=+4.247909091 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:59.053845 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.053794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:50:59.054015 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.053978    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:50:59.054015 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.053999    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:50:59.054015 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.054009    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:59.054149 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.054070    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:00.054056228 +0000 UTC m=+4.348938726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:50:59.370870 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.370726    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ztxwh" event={"ID":"23c9debd-909e-4b72-8963-a656e42f1b8b","Type":"ContainerStarted","Data":"cde1c2c2b62f2a4be4570f0ec5037c2724af1a0ae706cfca6ea041412dd9213c"}
Jul 02 19:50:59.372591 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.372327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsm22" event={"ID":"1e52320f-3017-4db1-a6cc-43e306297148","Type":"ContainerStarted","Data":"022604440f7af314ea670d54d18fd653a86536d7d1b34bcc52158a2965279df8"}
Jul 02 19:50:59.373871 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.373796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs4br" event={"ID":"827191eb-bb3b-4112-97dc-fe9b593d14f4","Type":"ContainerStarted","Data":"ed76061b942d853619f62a1a6e8a46af05cf5ae0439b80983365b9e6f01aa1af"}
Jul 02 19:50:59.375353 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.375293    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6lj5l" event={"ID":"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b","Type":"ContainerStarted","Data":"0c172122e9747d2e1c0b33b4f33daf1da63c2a7328dacffb37a8fc1b614c3ca9"}
Jul 02 19:50:59.376992 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.376968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"1f82daa07a80fdc56361af3c347d944420c30fc3d4b2ce93d1f69c12f7cc94b7"}
Jul 02 19:50:59.378115 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.378076    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:45:58 +0000 UTC" deadline="2028-04-01 03:36:34.957888402 +0000 UTC"
Jul 02 19:50:59.378115 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.378117    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15319h45m35.579776124s"
Jul 02 19:50:59.379015 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.378989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smftc" event={"ID":"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf","Type":"ContainerStarted","Data":"70dbb65906520070b49e24b6b6dfaeddd79d4646627cf339acee0970b5f5247b"}
Jul 02 19:50:59.380957 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.380934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fcjwf" event={"ID":"789a4b31-a62b-46cf-b64c-48a57fbedaac","Type":"ContainerStarted","Data":"59cc9d8db0487d6ac948f2a643897fa5ef64e8fa66600bf43bae1f06813dce69"}
Jul 02 19:50:59.383009 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.382984    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf" event={"ID":"252c8b1e-10ab-4aee-80f4-f1f1f404e20c","Type":"ContainerStarted","Data":"07cd4cf3f049b94677b3e2cbccdbb42452d6d7286643904f1ddff7686585b3e4"}
Jul 02 19:50:59.384490 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.384460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerStarted","Data":"795d6349ab92a05fb3f3d75625cc862ba67bed5770a777064622a54d393cc126"}
Jul 02 19:50:59.962871 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.962809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:50:59.962871 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:50:59.962868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:50:59.963176 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.963026    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:59.963176 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.963098    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:01.963076518 +0000 UTC m=+6.257959015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:50:59.963561 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.963540    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:50:59.963665 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:50:59.963606    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:01.963586779 +0000 UTC m=+6.258469276 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:00.063249 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:00.063211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:00.063438 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.063423    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:00.063512 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.063445    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:00.063512 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.063458    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:00.063623 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.063521    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:02.0635007 +0000 UTC m=+6.358383210 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:00.258645 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:00.258089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:00.258645 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.258231    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:00.258645 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:00.258319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:00.258645 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.258446    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:00.258645 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:00.258089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:00.258645 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:00.258546    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:00.379373 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:00.379220    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:45:58 +0000 UTC" deadline="2028-04-09 04:04:27.322051386 +0000 UTC"
Jul 02 19:51:00.379373 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:00.379266    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15512h13m26.942790824s"
Jul 02 19:51:01.410776 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:01.409733    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" event={"ID":"0e830bc32dc0970f441a153655ff8620","Type":"ContainerStarted","Data":"8d04ad9241629382dd4088024305c364ba33fa05d2a037c6825e4a157c09e2c5"}
Jul 02 19:51:01.981511 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:01.981086    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:01.981511 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:01.981168    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:05.981149214 +0000 UTC m=+10.276031712 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:01.982245 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:01.980868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:01.982245 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:01.981997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:01.982245 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:01.982130    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:01.982245 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:01.982180    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:05.982164641 +0000 UTC m=+10.277047137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:02.083890 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.083223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:02.083890 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.083434    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:02.083890 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.083458    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:02.083890 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.083471    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:02.083890 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.083538    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:06.083516322 +0000 UTC m=+10.378398815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:02.259338 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.259302    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:02.259801 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.259561    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:02.259801 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.259410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:02.259801 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.259746    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:02.260071 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.259981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:02.260125 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:02.260064    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:02.417820 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.416741    2562 generic.go:356] "Generic (PLEG): container finished" podID="ea1ee2087c460df8e4c2dc1d21fd4480" containerID="08c1e586ecdd6028b8251977d329e3914ade2ea6a0e74e46d17442c660bf7043" exitCode=0
Jul 02 19:51:02.417820 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.417596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"ea1ee2087c460df8e4c2dc1d21fd4480","Type":"ContainerDied","Data":"08c1e586ecdd6028b8251977d329e3914ade2ea6a0e74e46d17442c660bf7043"}
Jul 02 19:51:02.443098 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:02.443034    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-37.ec2.internal" podStartSLOduration=5.4430101650000005 podStartE2EDuration="5.443010165s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:01.428793348 +0000 UTC m=+5.723675862" watchObservedRunningTime="2026-07-02 19:51:02.443010165 +0000 UTC m=+6.737892678"
Jul 02 19:51:04.259055 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:04.258824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:04.259055 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:04.258884    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:04.259055 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:04.258827    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:04.259055 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:04.259004    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:04.259679 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:04.259081    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:04.259679 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:04.259159    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:06.017764 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:06.017643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:06.017764 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:06.017696    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:06.018277 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.017836    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:06.018277 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.017854    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:06.018277 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.017923    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:14.017900883 +0000 UTC m=+18.312783387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:06.018277 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.017945    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:14.017934369 +0000 UTC m=+18.312816865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:06.118407 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:06.118371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:06.118594 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.118543    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:06.118594 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.118560    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:06.118594 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.118570    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:06.118756 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.118624    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:14.118608073 +0000 UTC m=+18.413490565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:06.262152 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:06.261371    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:06.262152 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.261493    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:06.262152 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:06.261857    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:06.262152 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.261966    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:06.262152 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:06.262020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:06.262152 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:06.262099    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:08.259629 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:08.259583    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:08.260106 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:08.259595    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:08.260106 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:08.259705    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:08.260106 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:08.259850    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:08.260106 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:08.259949    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:08.260106 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:08.260038    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:10.258698 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:10.258670    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:10.259184 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:10.258704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:10.259184 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:10.258670    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:10.259184 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:10.258801    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:10.259184 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:10.258899    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:10.259184 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:10.258975    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:12.258895 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:12.258838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:12.258895 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:12.258838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:12.258895 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:12.258892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:12.259431 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:12.259010    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:12.259431 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:12.259160    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:12.259431 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:12.259246    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:14.081541 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:14.081506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:14.081541 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:14.081548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:14.082090 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.081659    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:14.082090 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.081671    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:14.082090 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.081718    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:30.081704366 +0000 UTC m=+34.376586866 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:14.082090 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.081738    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:30.081727237 +0000 UTC m=+34.376609732 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:14.183197 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:14.183151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:14.183424 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.183405    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:14.183502 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.183430    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:14.183502 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.183443    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:14.183593 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.183512    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:51:30.183493341 +0000 UTC m=+34.478375849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:14.258353 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:14.258315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:14.258353 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:14.258335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:14.258602 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.258461    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:14.258602 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.258574    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:14.258709 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:14.258674    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:14.258810 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:14.258789    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:16.259822 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:16.259780    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:16.260281 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:16.259870    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:16.260281 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:16.259922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:16.260281 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:16.259929    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:16.260281 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:16.260014    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:16.260281 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:16.260098    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:18.259305 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.258975    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:18.260084 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.258985    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:18.260084 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:18.259400    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:18.260084 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.259024    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:18.260084 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:18.259475    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:18.260084 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:18.259611    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:18.449800 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.449767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ztxwh" event={"ID":"23c9debd-909e-4b72-8963-a656e42f1b8b","Type":"ContainerStarted","Data":"43ed83f530358f9a2948bbb85822b8afc542aa611b2ca69349978bffd8094db5"}
Jul 02 19:51:18.451273 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.451247    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsm22" event={"ID":"1e52320f-3017-4db1-a6cc-43e306297148","Type":"ContainerStarted","Data":"bab8360da04b51a08f61b7f899ad0530b5a0ab5901b51f364b178d3f5f4c1b42"}
Jul 02 19:51:18.452558 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.452538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6lj5l" event={"ID":"bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b","Type":"ContainerStarted","Data":"b342ff48a4e993670872ed969332c6b09610fc26cc8e335b71799c8ff81ef71f"}
Jul 02 19:51:18.454377 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.454357    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"89e1d32b114b3932243e4540b4c4326d81746f2ccdf61413c25a522f32253343"}
Jul 02 19:51:18.454466 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.454416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"45a32a74a5b5a00c931d8aeea1351f25e9980d7e7a54706495b620bd9a86e75f"}
Jul 02 19:51:18.454466 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.454461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"050bd4349451c0dcac283a12827878cff09d5f82a7322030254519f3389a944d"}
Jul 02 19:51:18.455477 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.455450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smftc" event={"ID":"6cd1f8e4-93fd-4a05-b34a-bd0132828dbf","Type":"ContainerStarted","Data":"6c760c5da906bcfbeb2f495754ba24db175f48ad9adfbcbd82522c402b3bc4ff"}
Jul 02 19:51:18.458513 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.458490    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fcjwf" event={"ID":"789a4b31-a62b-46cf-b64c-48a57fbedaac","Type":"ContainerStarted","Data":"0952770e746d4ca7934eb2bb54f131b5dc5d4557cd01fef233eb3696dd9c3b2b"}
Jul 02 19:51:18.459969 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.459950    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" event={"ID":"ea1ee2087c460df8e4c2dc1d21fd4480","Type":"ContainerStarted","Data":"a4726c0f8184d6b9a1bba74d7421cedf32f6f70166ddabac0be7a4e575848565"}
Jul 02 19:51:18.461310 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.461289    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf" event={"ID":"252c8b1e-10ab-4aee-80f4-f1f1f404e20c","Type":"ContainerStarted","Data":"665c62c9a4cecab1028bb5db2f2a485ee5a44e263b8427a0913c6f7e9746dc4a"}
Jul 02 19:51:18.462758 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.462734    2562 generic.go:356] "Generic (PLEG): container finished" podID="da700b65-1646-4596-95d4-4d635686f180" containerID="a4d0af0425d5f1357c567fc00bc6f18bd348351672fafbcfff63141d9c6f01f7" exitCode=0
Jul 02 19:51:18.462831 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.462773    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerDied","Data":"a4d0af0425d5f1357c567fc00bc6f18bd348351672fafbcfff63141d9c6f01f7"}
Jul 02 19:51:18.481355 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.481313    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ztxwh" podStartSLOduration=7.427184785 podStartE2EDuration="22.481298204s" totalImagesPullingTime="15.054113419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.465559183 +0000 UTC m=+22.760441699" watchObservedRunningTime="2026-07-02 19:51:18.481298204 +0000 UTC m=+22.776180717"
Jul 02 19:51:18.504069 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.504015    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lsm22" podStartSLOduration=3.179174772 podStartE2EDuration="22.5039966s" totalImagesPullingTime="19.324821828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.481191387 +0000 UTC m=+22.776073902" watchObservedRunningTime="2026-07-02 19:51:18.5039966 +0000 UTC m=+22.798879118"
Jul 02 19:51:18.518850 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.518811    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fcjwf" podStartSLOduration=3.080141393 podStartE2EDuration="22.51879757s" totalImagesPullingTime="19.438656177s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.518695622 +0000 UTC m=+22.813578136" watchObservedRunningTime="2026-07-02 19:51:18.51879757 +0000 UTC m=+22.813680081"
Jul 02 19:51:18.538296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.538248    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-smftc" podStartSLOduration=3.096923272 podStartE2EDuration="22.538237982s" totalImagesPullingTime="19.44131471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.538126048 +0000 UTC m=+22.833008561" watchObservedRunningTime="2026-07-02 19:51:18.538237982 +0000 UTC m=+22.833120495"
Jul 02 19:51:18.554730 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.554682    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-37.ec2.internal" podStartSLOduration=21.554660817 podStartE2EDuration="21.554660817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.55430764 +0000 UTC m=+22.849190152" watchObservedRunningTime="2026-07-02 19:51:18.554660817 +0000 UTC m=+22.849543330"
Jul 02 19:51:18.575691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:18.575647    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6lj5l" podStartSLOduration=3.094815545 podStartE2EDuration="22.575628708s" totalImagesPullingTime="19.480813163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:18.575590325 +0000 UTC m=+22.870472841" watchObservedRunningTime="2026-07-02 19:51:18.575628708 +0000 UTC m=+22.870511204"
Jul 02 19:51:19.374043 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.374013    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 02 19:51:19.469605 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.469569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"71cc9e4b990565927a64e09bc8d39e02a5f9525382171aa914cf9d4fa47039e7"}
Jul 02 19:51:19.469954 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.469682    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"20eb0c6bed7bfce73939a692df2c094f412ef2b164c40b59cb214aa9327be1af"}
Jul 02 19:51:19.469954 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.469731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"4bcf1b8aeeed097ab17fcea8ae9e110d95b6cb2b46408425523ca45816c68a52"}
Jul 02 19:51:19.471617 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.471584    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf" event={"ID":"252c8b1e-10ab-4aee-80f4-f1f1f404e20c","Type":"ContainerStarted","Data":"6cce23c058e0c07ffab28bd328d65cf33fa8e9b917798b648d207f43cc21eb3c"}
Jul 02 19:51:19.473252 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.473223    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qs4br" event={"ID":"827191eb-bb3b-4112-97dc-fe9b593d14f4","Type":"ContainerStarted","Data":"edab55119ffb9c69b1e5cd793586092448c81ce8528cc55f413db99c6407e6f1"}
Jul 02 19:51:19.492566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:19.492514    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qs4br" podStartSLOduration=4.116285403 podStartE2EDuration="23.492498293s" totalImagesPullingTime="19.37621289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:19.492001317 +0000 UTC m=+23.786883832" watchObservedRunningTime="2026-07-02 19:51:19.492498293 +0000 UTC m=+23.787380806"
Jul 02 19:51:20.170120 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:20.170011    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:51:19.374038241Z","UUID":"050cc0ac-04e1-4de5-8029-59cbb1e6bf7a","Handler":null,"Name":"","Endpoint":""}
Jul 02 19:51:20.171770 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:20.171742    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 02 19:51:20.171919 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:20.171799    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 02 19:51:20.258393 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:20.258358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:20.258576 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:20.258413    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:20.258576 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:20.258359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:20.258576 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:20.258499    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:20.258576 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:20.258566    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:20.258781 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:20.258646    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:21.398298 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.398263    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:51:21.398869 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.398843    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:51:21.480392 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.480355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf" event={"ID":"252c8b1e-10ab-4aee-80f4-f1f1f404e20c","Type":"ContainerStarted","Data":"e8165eb7b88b21922da7f8b08e05a10cebaaf11ef0787bffde1554cea56432de"}
Jul 02 19:51:21.483505 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.483480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"340f81f2686d6f6f9df4ae0097411b9691c0335e49bc4467dfe0651bfcfe91e8"}
Jul 02 19:51:21.483682 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.483670    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:51:21.484171 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.484155    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ztxwh"
Jul 02 19:51:21.497883 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:21.497836    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l2vf" podStartSLOduration=8.026021111 podStartE2EDuration="25.497824754s" totalImagesPullingTime="17.471803643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:21.497588995 +0000 UTC m=+25.792471637" watchObservedRunningTime="2026-07-02 19:51:21.497824754 +0000 UTC m=+25.792707266"
Jul 02 19:51:22.258019 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:22.257990    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:22.258019 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:22.258000    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:22.258286 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:22.258004    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:22.258286 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:22.258113    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:22.258286 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:22.258202    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:22.258433 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:22.258290    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:23.491865 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.491598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" event={"ID":"8e55f232-5890-4ccb-80ce-8d7a63893da2","Type":"ContainerStarted","Data":"2d7c9e2d1cc048d7210832952e0e7c38881ef62a670d246cd8751684cb9c5749"}
Jul 02 19:51:23.492651 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.491962    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:51:23.492651 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.492015    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:51:23.492651 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.492058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:51:23.493685 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.493666    2562 generic.go:356] "Generic (PLEG): container finished" podID="da700b65-1646-4596-95d4-4d635686f180" containerID="725eb442ef6765ef4bb78b4f3723be7c43dc80832a73b635c918d5f52754a13e" exitCode=0
Jul 02 19:51:23.493799 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.493758    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerDied","Data":"725eb442ef6765ef4bb78b4f3723be7c43dc80832a73b635c918d5f52754a13e"}
Jul 02 19:51:23.507271 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.507248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:51:23.507384 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.507354    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:51:23.520918 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:23.520866    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24" podStartSLOduration=8.008459811 podStartE2EDuration="27.520852034s" totalImagesPullingTime="19.512392223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:23.520346143 +0000 UTC m=+27.815228656" watchObservedRunningTime="2026-07-02 19:51:23.520852034 +0000 UTC m=+27.815734697"
Jul 02 19:51:24.258958 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:24.258733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:24.259157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:24.258733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:24.259157 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:24.259046    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:24.259157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:24.258742    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:24.259304 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:24.259104    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:24.259304 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:24.259229    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:25.445440 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.445377    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7vbkc"]
Jul 02 19:51:25.445850 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.445576    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:25.445850 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:25.445753    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:25.448582 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.448555    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7j2wv"]
Jul 02 19:51:25.448731 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.448655    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:25.448776 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:25.448739    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:25.461125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.461066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d4khc"]
Jul 02 19:51:25.461287 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.461209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:25.461345 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:25.461320    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:25.501008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.500975    2562 generic.go:356] "Generic (PLEG): container finished" podID="da700b65-1646-4596-95d4-4d635686f180" containerID="95af865341017f52c58ed963ddc359481c6f8d5df191de6ce077d7ac73092658" exitCode=0
Jul 02 19:51:25.501248 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:25.501056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerDied","Data":"95af865341017f52c58ed963ddc359481c6f8d5df191de6ce077d7ac73092658"}
Jul 02 19:51:27.258008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:27.257974    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:27.258008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:27.258008    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:27.258475 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:27.257974    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:27.258475 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:27.258094    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:27.258475 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:27.258145    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:27.258475 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:27.258232    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:27.508998 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:27.508669    2562 generic.go:356] "Generic (PLEG): container finished" podID="da700b65-1646-4596-95d4-4d635686f180" containerID="7f63c41cd7e63358fab558bfd23f7050ffac9614b81c989f2ad4eec560e7f5be" exitCode=0
Jul 02 19:51:27.508998 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:27.508744    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerDied","Data":"7f63c41cd7e63358fab558bfd23f7050ffac9614b81c989f2ad4eec560e7f5be"}
Jul 02 19:51:29.258286 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:29.258239    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:29.258286 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:29.258287    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:29.258792 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:29.258238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:29.258792 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:29.258399    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7j2wv" podUID="5d15d4cd-f8d6-4cbc-8169-d05382ce5729"
Jul 02 19:51:29.258792 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:29.258491    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7vbkc" podUID="ae816d1e-f53b-43a4-a553-cc5651a184b2"
Jul 02 19:51:29.258792 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:29.258585    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d4khc" podUID="e0a9b261-b173-4a40-97a4-89d9fac0dc5b"
Jul 02 19:51:30.101034 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.101006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:30.101034 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.101038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:30.101253 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.101147    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:30.101253 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.101208    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs podName:ae816d1e-f53b-43a4-a553-cc5651a184b2 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:02.101191906 +0000 UTC m=+66.396074401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs") pod "network-metrics-daemon-7vbkc" (UID: "ae816d1e-f53b-43a4-a553-cc5651a184b2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 02 19:51:30.101253 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.101147    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:30.101386 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.101318    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret podName:5d15d4cd-f8d6-4cbc-8169-d05382ce5729 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:02.101293208 +0000 UTC m=+66.396175713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret") pod "global-pull-secret-syncer-7j2wv" (UID: "5d15d4cd-f8d6-4cbc-8169-d05382ce5729") : object "kube-system"/"original-pull-secret" not registered
Jul 02 19:51:30.201388 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.201353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:30.201599 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.201519    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 02 19:51:30.201599 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.201544    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 02 19:51:30.201599 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.201559    2562 projected.go:196] Error preparing data for projected volume kube-api-access-5n5wp for pod openshift-network-diagnostics/network-check-target-d4khc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:30.201726 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.201615    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp podName:e0a9b261-b173-4a40-97a4-89d9fac0dc5b nodeName:}" failed. No retries permitted until 2026-07-02 19:52:02.201598952 +0000 UTC m=+66.496481448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5n5wp" (UniqueName: "kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp") pod "network-check-target-d4khc" (UID: "e0a9b261-b173-4a40-97a4-89d9fac0dc5b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 02 19:51:30.505783 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.505752    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-37.ec2.internal" event="NodeReady"
Jul 02 19:51:30.506199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.505916    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 02 19:51:30.546341 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.546303    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75cf8b7f58-b6f4s"]
Jul 02 19:51:30.549118 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.549077    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.552050 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.552016    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbvl2\""
Jul 02 19:51:30.552233 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.552056    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 02 19:51:30.552233 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.552087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 02 19:51:30.552590 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.552567    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 02 19:51:30.558131 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.558098    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sm6nq"]
Jul 02 19:51:30.559395 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.559372    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 02 19:51:30.560059 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.560039    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.561392 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.561354    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-twpdr"]
Jul 02 19:51:30.562566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.562547    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 02 19:51:30.562676 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.562656    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 02 19:51:30.562735 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.562705    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 02 19:51:30.562790 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.562773    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wlfnm\""
Jul 02 19:51:30.563379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.563362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.565523 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.565360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75cf8b7f58-b6f4s"]
Jul 02 19:51:30.565632 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.565580    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 02 19:51:30.565997 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.565976    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 02 19:51:30.566088 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.566021    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-67xbm\""
Jul 02 19:51:30.576476 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.576435    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-twpdr"]
Jul 02 19:51:30.579083 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.578963    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sm6nq"]
Jul 02 19:51:30.706324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-image-registry-private-configuration\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wd6v\" (UniqueName: \"kubernetes.io/projected/f5eff5d8-623d-4712-855c-434fc2f17ce1-kube-api-access-8wd6v\") pod \"ingress-canary-sm6nq\" (UID: \"f5eff5d8-623d-4712-855c-434fc2f17ce1\") " pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.706574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706336    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-ca-trust-extracted\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-bound-sa-token\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706418    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bt5v\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-kube-api-access-2bt5v\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-config-volume\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.706574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-certificates\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.706859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-tmp-dir\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.706859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vxcp\" (UniqueName: \"kubernetes.io/projected/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-kube-api-access-7vxcp\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.706859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-trusted-ca\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-installation-pull-secrets\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.706859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.706761    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5eff5d8-623d-4712-855c-434fc2f17ce1-cert\") pod \"ingress-canary-sm6nq\" (UID: \"f5eff5d8-623d-4712-855c-434fc2f17ce1\") " pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.807563 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-certificates\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.807563 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807571    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-tmp-dir\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vxcp\" (UniqueName: \"kubernetes.io/projected/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-kube-api-access-7vxcp\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807645    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-trusted-ca\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-installation-pull-secrets\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807702    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5eff5d8-623d-4712-855c-434fc2f17ce1-cert\") pod \"ingress-canary-sm6nq\" (UID: \"f5eff5d8-623d-4712-855c-434fc2f17ce1\") " pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-image-registry-private-configuration\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.807821 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.807768    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.807831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls podName:c0af3202-a5d5-4e43-a9b6-60b7a0d22abc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:31.307811319 +0000 UTC m=+35.602693832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls") pod "dns-default-twpdr" (UID: "c0af3202-a5d5-4e43-a9b6-60b7a0d22abc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wd6v\" (UniqueName: \"kubernetes.io/projected/f5eff5d8-623d-4712-855c-434fc2f17ce1-kube-api-access-8wd6v\") pod \"ingress-canary-sm6nq\" (UID: \"f5eff5d8-623d-4712-855c-434fc2f17ce1\") " pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.807968    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-ca-trust-extracted\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-bound-sa-token\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808061    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bt5v\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-kube-api-access-2bt5v\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.808123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808094    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-config-volume\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.808324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808295    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-certificates\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.808396 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.808379    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:51:30.808428 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.808400    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75cf8b7f58-b6f4s: secret "image-registry-tls" not found
Jul 02 19:51:30.808462 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-tmp-dir\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.808462 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:30.808444    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls podName:d920afa3-f62b-4b0e-8225-b40b4f9a3bc1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:31.308427777 +0000 UTC m=+35.603310278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls") pod "image-registry-75cf8b7f58-b6f4s" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1") : secret "image-registry-tls" not found
Jul 02 19:51:30.808662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-trusted-ca\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.808793 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.808702    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-ca-trust-extracted\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.809034 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.809009    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-config-volume\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.812603 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.812582    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5eff5d8-623d-4712-855c-434fc2f17ce1-cert\") pod \"ingress-canary-sm6nq\" (UID: \"f5eff5d8-623d-4712-855c-434fc2f17ce1\") " pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.812603 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.812589    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-installation-pull-secrets\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.812759 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.812592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-image-registry-private-configuration\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.817352 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.817302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wd6v\" (UniqueName: \"kubernetes.io/projected/f5eff5d8-623d-4712-855c-434fc2f17ce1-kube-api-access-8wd6v\") pod \"ingress-canary-sm6nq\" (UID: \"f5eff5d8-623d-4712-855c-434fc2f17ce1\") " pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:30.817554 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.817524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vxcp\" (UniqueName: \"kubernetes.io/projected/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-kube-api-access-7vxcp\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:30.817676 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.817594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-bound-sa-token\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.818313 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.818293    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bt5v\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-kube-api-access-2bt5v\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:30.872633 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:30.872592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sm6nq"
Jul 02 19:51:31.258804 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.258759    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:51:31.258997 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.258807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:51:31.258997 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.258807    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:51:31.261870 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.261841    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmhzg\""
Jul 02 19:51:31.262027 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.261854    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:51:31.262749 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.262728    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:51:31.262972 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.262950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:51:31.263072 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.262955    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkjw9\""
Jul 02 19:51:31.263072 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.263030    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:51:31.315927 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.315885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:31.316115 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.315974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:31.316115 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:31.316028    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:51:31.316115 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:31.316050    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75cf8b7f58-b6f4s: secret "image-registry-tls" not found
Jul 02 19:51:31.316115 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:31.316087    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:31.316330 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:31.316123    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls podName:d920afa3-f62b-4b0e-8225-b40b4f9a3bc1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:32.316102068 +0000 UTC m=+36.610984579 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls") pod "image-registry-75cf8b7f58-b6f4s" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1") : secret "image-registry-tls" not found
Jul 02 19:51:31.316330 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:31.316139    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls podName:c0af3202-a5d5-4e43-a9b6-60b7a0d22abc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:32.316132378 +0000 UTC m=+36.611014869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls") pod "dns-default-twpdr" (UID: "c0af3202-a5d5-4e43-a9b6-60b7a0d22abc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:31.758283 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:31.758004    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sm6nq"]
Jul 02 19:51:31.760790 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:51:31.760760    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5eff5d8_623d_4712_855c_434fc2f17ce1.slice/crio-f6ab29ce24dc860ba99fe6692a8a10dad025c43994207af39cf3a88b016776fd WatchSource:0}: Error finding container f6ab29ce24dc860ba99fe6692a8a10dad025c43994207af39cf3a88b016776fd: Status 404 returned error can't find the container with id f6ab29ce24dc860ba99fe6692a8a10dad025c43994207af39cf3a88b016776fd
Jul 02 19:51:32.325351 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:32.325317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:32.325546 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:32.325376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:32.325546 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:32.325483    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:32.325546 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:32.325499    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:51:32.325546 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:32.325522    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75cf8b7f58-b6f4s: secret "image-registry-tls" not found
Jul 02 19:51:32.325546 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:32.325536    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls podName:c0af3202-a5d5-4e43-a9b6-60b7a0d22abc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:34.325523385 +0000 UTC m=+38.620405876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls") pod "dns-default-twpdr" (UID: "c0af3202-a5d5-4e43-a9b6-60b7a0d22abc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:32.325750 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:32.325574    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls podName:d920afa3-f62b-4b0e-8225-b40b4f9a3bc1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:34.325557059 +0000 UTC m=+38.620439586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls") pod "image-registry-75cf8b7f58-b6f4s" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1") : secret "image-registry-tls" not found
Jul 02 19:51:32.524961 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:32.524927    2562 generic.go:356] "Generic (PLEG): container finished" podID="da700b65-1646-4596-95d4-4d635686f180" containerID="c31ddf01656f3ddbf2cd55bfb8a57b2a13764f02f4e2ddd4044c81e1536eb36d" exitCode=0
Jul 02 19:51:32.525153 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:32.525017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerDied","Data":"c31ddf01656f3ddbf2cd55bfb8a57b2a13764f02f4e2ddd4044c81e1536eb36d"}
Jul 02 19:51:32.526257 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:32.526222    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sm6nq" event={"ID":"f5eff5d8-623d-4712-855c-434fc2f17ce1","Type":"ContainerStarted","Data":"f6ab29ce24dc860ba99fe6692a8a10dad025c43994207af39cf3a88b016776fd"}
Jul 02 19:51:33.532946 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:33.532909    2562 generic.go:356] "Generic (PLEG): container finished" podID="da700b65-1646-4596-95d4-4d635686f180" containerID="3d1f0c60e1dfdde316ef99c6e58c20b39d7f7d9611ab666d34bab51d8cecc013" exitCode=0
Jul 02 19:51:33.533418 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:33.532959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerDied","Data":"3d1f0c60e1dfdde316ef99c6e58c20b39d7f7d9611ab666d34bab51d8cecc013"}
Jul 02 19:51:34.342973 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:34.342923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:34.343118 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:34.343004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:34.343118 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:34.343084    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:51:34.343118 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:34.343099    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75cf8b7f58-b6f4s: secret "image-registry-tls" not found
Jul 02 19:51:34.343225 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:34.343152    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls podName:d920afa3-f62b-4b0e-8225-b40b4f9a3bc1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.343137213 +0000 UTC m=+42.638019707 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls") pod "image-registry-75cf8b7f58-b6f4s" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1") : secret "image-registry-tls" not found
Jul 02 19:51:34.343225 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:34.343149    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:34.343225 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:34.343204    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls podName:c0af3202-a5d5-4e43-a9b6-60b7a0d22abc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.343189291 +0000 UTC m=+42.638071782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls") pod "dns-default-twpdr" (UID: "c0af3202-a5d5-4e43-a9b6-60b7a0d22abc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:34.539636 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:34.539595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6mz57" event={"ID":"da700b65-1646-4596-95d4-4d635686f180","Type":"ContainerStarted","Data":"9940a49b7627fad91b593add88230096b4a7e846014c8eb41d6c5fac1bb4320b"}
Jul 02 19:51:34.541191 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:34.541163    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sm6nq" event={"ID":"f5eff5d8-623d-4712-855c-434fc2f17ce1","Type":"ContainerStarted","Data":"1de75038fb2b5a699eb728be8a24e12107fd4c50eca1aa217251fc06eb2b734c"}
Jul 02 19:51:34.567238 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:34.566945    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6mz57" podStartSLOduration=8.068934093 podStartE2EDuration="38.56691626s" totalImagesPullingTime="30.497982167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:34.56505483 +0000 UTC m=+38.859937345" watchObservedRunningTime="2026-07-02 19:51:34.56691626 +0000 UTC m=+38.861798771"
Jul 02 19:51:34.581287 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:34.581227    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sm6nq" podStartSLOduration=1.993788361 podStartE2EDuration="4.581204811s" totalImagesPullingTime="2.58741645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:34.580788318 +0000 UTC m=+38.875670832" watchObservedRunningTime="2026-07-02 19:51:34.581204811 +0000 UTC m=+38.876087326"
Jul 02 19:51:37.309151 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.309116    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8prsh"]
Jul 02 19:51:37.343275 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.343243    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8prsh"]
Jul 02 19:51:37.343786 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.343763    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.348609 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.348580    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 02 19:51:37.348778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.348580    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 02 19:51:37.348778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.348577    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 02 19:51:37.348778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.348584    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 02 19:51:37.349304 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.349290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lvrrb\""
Jul 02 19:51:37.466431 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.466391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8bfd839-737e-4eec-8fc3-337109d446f2-crio-socket\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.466431 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.466435    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm68h\" (UniqueName: \"kubernetes.io/projected/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-api-access-mm68h\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.466649 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.466457    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.466649 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.466477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8bfd839-737e-4eec-8fc3-337109d446f2-data-volume\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.466649 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.466493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567050 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.566966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm68h\" (UniqueName: \"kubernetes.io/projected/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-api-access-mm68h\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567050 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.567006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567050 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.567029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8bfd839-737e-4eec-8fc3-337109d446f2-data-volume\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567315 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:37.567138    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:37.567315 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.567145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567315 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:37.567213    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.067192226 +0000 UTC m=+42.362074732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:37.567315 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:37.567239    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:51:37.567315 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:37.567289    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:38.067276446 +0000 UTC m=+42.362158937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:51:37.567315 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.567308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b8bfd839-737e-4eec-8fc3-337109d446f2-data-volume\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567570 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.567336    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8bfd839-737e-4eec-8fc3-337109d446f2-crio-socket\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.567570 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.567513    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b8bfd839-737e-4eec-8fc3-337109d446f2-crio-socket\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:37.584947 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:37.584912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm68h\" (UniqueName: \"kubernetes.io/projected/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-api-access-mm68h\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:38.071122 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:38.071082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:38.071122 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:38.071123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:38.071346 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.071240    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:38.071346 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.071306    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:39.071290568 +0000 UTC m=+43.366173064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:38.071346 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.071244    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:51:38.071461 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.071383    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:39.071370271 +0000 UTC m=+43.366252763 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:51:38.373678 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:38.373576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:38.373678 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:38.373636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:38.374124 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.373722    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:38.374124 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.373728    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:51:38.374124 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.373748    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75cf8b7f58-b6f4s: secret "image-registry-tls" not found
Jul 02 19:51:38.374124 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.373782    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls podName:c0af3202-a5d5-4e43-a9b6-60b7a0d22abc nodeName:}" failed. No retries permitted until 2026-07-02 19:51:46.373766984 +0000 UTC m=+50.668649477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls") pod "dns-default-twpdr" (UID: "c0af3202-a5d5-4e43-a9b6-60b7a0d22abc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:38.374124 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:38.373847    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls podName:d920afa3-f62b-4b0e-8225-b40b4f9a3bc1 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:46.37383198 +0000 UTC m=+50.668714475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls") pod "image-registry-75cf8b7f58-b6f4s" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1") : secret "image-registry-tls" not found
Jul 02 19:51:39.079008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:39.078970    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:39.079008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:39.079020    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:39.079238 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:39.079123    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:39.079238 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:39.079188    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.0791733 +0000 UTC m=+45.374055792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:39.079238 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:39.079128    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 02 19:51:39.079382 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:39.079281    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:41.079265673 +0000 UTC m=+45.374148164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : configmap "kube-rbac-proxy" not found
Jul 02 19:51:39.290022 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:39.289986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsm22_1e52320f-3017-4db1-a6cc-43e306297148/dns-node-resolver/0.log"
Jul 02 19:51:40.050004 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.049966    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s76fg"]
Jul 02 19:51:40.070470 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.070434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s76fg"]
Jul 02 19:51:40.070689 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.070544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.073138 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.073113    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 02 19:51:40.073293 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.073277    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 02 19:51:40.074176 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.074127    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 02 19:51:40.074304 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.074187    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bpqbm\""
Jul 02 19:51:40.074304 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.074203    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 02 19:51:40.187709 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.187671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcp8k\" (UniqueName: \"kubernetes.io/projected/56081ba1-c955-4d40-9a06-e7a070cb9b72-kube-api-access-hcp8k\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.187914 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.187809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56081ba1-c955-4d40-9a06-e7a070cb9b72-signing-cabundle\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.187914 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.187857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56081ba1-c955-4d40-9a06-e7a070cb9b72-signing-key\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.288630 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.288589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56081ba1-c955-4d40-9a06-e7a070cb9b72-signing-cabundle\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.288630 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.288633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56081ba1-c955-4d40-9a06-e7a070cb9b72-signing-key\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.288863 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.288842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcp8k\" (UniqueName: \"kubernetes.io/projected/56081ba1-c955-4d40-9a06-e7a070cb9b72-kube-api-access-hcp8k\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.289438 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.289413    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/56081ba1-c955-4d40-9a06-e7a070cb9b72-signing-cabundle\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.291145 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.291117    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/56081ba1-c955-4d40-9a06-e7a070cb9b72-signing-key\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.297282 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.297261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcp8k\" (UniqueName: \"kubernetes.io/projected/56081ba1-c955-4d40-9a06-e7a070cb9b72-kube-api-access-hcp8k\") pod \"service-ca-758f599c5-s76fg\" (UID: \"56081ba1-c955-4d40-9a06-e7a070cb9b72\") " pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.380403 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.380310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-s76fg"
Jul 02 19:51:40.491830 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.491809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fcjwf_789a4b31-a62b-46cf-b64c-48a57fbedaac/node-ca/0.log"
Jul 02 19:51:40.519180 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.519150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-s76fg"]
Jul 02 19:51:40.522373 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:51:40.522343    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56081ba1_c955_4d40_9a06_e7a070cb9b72.slice/crio-5c1c2421f94c72f1424b6fb1f944e3ead5d58bfd681dc2ab631fc21f99ed3ecc WatchSource:0}: Error finding container 5c1c2421f94c72f1424b6fb1f944e3ead5d58bfd681dc2ab631fc21f99ed3ecc: Status 404 returned error can't find the container with id 5c1c2421f94c72f1424b6fb1f944e3ead5d58bfd681dc2ab631fc21f99ed3ecc
Jul 02 19:51:40.557699 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:40.557659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s76fg" event={"ID":"56081ba1-c955-4d40-9a06-e7a070cb9b72","Type":"ContainerStarted","Data":"5c1c2421f94c72f1424b6fb1f944e3ead5d58bfd681dc2ab631fc21f99ed3ecc"}
Jul 02 19:51:41.103519 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:41.103480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:41.103519 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:41.103529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:41.104160 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:41.103657    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:41.104160 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:41.103729    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:45.103708661 +0000 UTC m=+49.398591158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:41.104160 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:41.104109    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b8bfd839-737e-4eec-8fc3-337109d446f2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:41.291403 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:41.291371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sm6nq_f5eff5d8-623d-4712-855c-434fc2f17ce1/serve-healthcheck-canary/0.log"
Jul 02 19:51:43.566303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:43.566261    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-s76fg" event={"ID":"56081ba1-c955-4d40-9a06-e7a070cb9b72","Type":"ContainerStarted","Data":"7f22e528ad40213fa936bf514f98bb410e7a7999809352433ecbcbafc7fcc4c8"}
Jul 02 19:51:43.589822 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:43.589758    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-s76fg" podStartSLOduration=0.967495134 podStartE2EDuration="3.589741982s" totalImagesPullingTime="2.622246848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:51:43.588892637 +0000 UTC m=+47.883775141" watchObservedRunningTime="2026-07-02 19:51:43.589741982 +0000 UTC m=+47.884624489"
Jul 02 19:51:45.137430 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:45.137239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:45.137958 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:45.137395    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:45.137958 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:45.137681    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls podName:b8bfd839-737e-4eec-8fc3-337109d446f2 nodeName:}" failed. No retries permitted until 2026-07-02 19:51:53.137658509 +0000 UTC m=+57.432541016 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8prsh" (UID: "b8bfd839-737e-4eec-8fc3-337109d446f2") : secret "insights-runtime-extractor-tls" not found
Jul 02 19:51:46.448329 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:46.448283    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:51:46.448819 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:46.448344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:51:46.448819 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:46.448437    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 02 19:51:46.448819 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:46.448463    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-75cf8b7f58-b6f4s: secret "image-registry-tls" not found
Jul 02 19:51:46.448819 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:46.448442    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 02 19:51:46.448819 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:46.448516    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls podName:d920afa3-f62b-4b0e-8225-b40b4f9a3bc1 nodeName:}" failed. No retries permitted until 2026-07-02 19:52:02.448501913 +0000 UTC m=+66.743384403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls") pod "image-registry-75cf8b7f58-b6f4s" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1") : secret "image-registry-tls" not found
Jul 02 19:51:46.448819 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:51:46.448532    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls podName:c0af3202-a5d5-4e43-a9b6-60b7a0d22abc nodeName:}" failed. No retries permitted until 2026-07-02 19:52:02.448526148 +0000 UTC m=+66.743408639 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls") pod "dns-default-twpdr" (UID: "c0af3202-a5d5-4e43-a9b6-60b7a0d22abc") : secret "dns-default-metrics-tls" not found
Jul 02 19:51:53.201687 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:53.201642    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:53.205496 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:53.205436    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b8bfd839-737e-4eec-8fc3-337109d446f2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8prsh\" (UID: \"b8bfd839-737e-4eec-8fc3-337109d446f2\") " pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:53.256078 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:53.256034    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8prsh"
Jul 02 19:51:53.387134 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:53.387007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8prsh"]
Jul 02 19:51:53.389741 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:51:53.389717    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8bfd839_737e_4eec_8fc3_337109d446f2.slice/crio-ab582b2013d89fa47d72c685c5672e3553a541fd59dc9619fe3ece2f579d1323 WatchSource:0}: Error finding container ab582b2013d89fa47d72c685c5672e3553a541fd59dc9619fe3ece2f579d1323: Status 404 returned error can't find the container with id ab582b2013d89fa47d72c685c5672e3553a541fd59dc9619fe3ece2f579d1323
Jul 02 19:51:53.589827 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:53.589789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8prsh" event={"ID":"b8bfd839-737e-4eec-8fc3-337109d446f2","Type":"ContainerStarted","Data":"ab582b2013d89fa47d72c685c5672e3553a541fd59dc9619fe3ece2f579d1323"}
Jul 02 19:51:55.512506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:55.512470    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9tm24"
Jul 02 19:51:58.604120 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:58.604027    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8prsh" event={"ID":"b8bfd839-737e-4eec-8fc3-337109d446f2","Type":"ContainerStarted","Data":"495e89b7ba0d9df25a39b00e09c03fe8c27c0e55d194dab1a1ffa38098aafbe5"}
Jul 02 19:51:58.604120 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:51:58.604095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8prsh" event={"ID":"b8bfd839-737e-4eec-8fc3-337109d446f2","Type":"ContainerStarted","Data":"55a93e9a6fc6396032cc3cefb0eff450ec12f924b32b4ba444f424489074dee6"}
Jul 02 19:52:01.614595 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:01.614557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8prsh" event={"ID":"b8bfd839-737e-4eec-8fc3-337109d446f2","Type":"ContainerStarted","Data":"f4c7918083371ca56a812ed78b65c599fc1da7ba9e46cc904c2b9d6ae10cfca1"}
Jul 02 19:52:01.637437 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:01.637377    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8prsh" podStartSLOduration=17.286701962 podStartE2EDuration="24.637360679s" totalImagesPullingTime="7.350658717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:51:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:01.635701697 +0000 UTC m=+65.930584223" watchObservedRunningTime="2026-07-02 19:52:01.637360679 +0000 UTC m=+65.932243191"
Jul 02 19:52:02.122081 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.122046    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"]
Jul 02 19:52:02.123776 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.123761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.129196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.129161    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 02 19:52:02.129336 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.129320    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 02 19:52:02.129336 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.129324    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 02 19:52:02.129447 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.129391    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 02 19:52:02.137522 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.137485    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"]
Jul 02 19:52:02.180168 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.180131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:52:02.180168 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.180177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-tmp\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.180413 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.180209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdqz\" (UniqueName: \"kubernetes.io/projected/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-kube-api-access-gfdqz\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.180413 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.180275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.180413 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.180343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:52:02.182898 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.182862    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 02 19:52:02.183062 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.183046    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 02 19:52:02.188069 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.188048    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75cf8b7f58-b6f4s"]
Jul 02 19:52:02.188225 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:02.188207    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s" podUID="d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"
Jul 02 19:52:02.193332 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.193311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5d15d4cd-f8d6-4cbc-8169-d05382ce5729-original-pull-secret\") pod \"global-pull-secret-syncer-7j2wv\" (UID: \"5d15d4cd-f8d6-4cbc-8169-d05382ce5729\") " pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:52:02.193426 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.193408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae816d1e-f53b-43a4-a553-cc5651a184b2-metrics-certs\") pod \"network-metrics-daemon-7vbkc\" (UID: \"ae816d1e-f53b-43a4-a553-cc5651a184b2\") " pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:52:02.218903 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.217437    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-5brg5"]
Jul 02 19:52:02.220656 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.220624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:02.223248 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.223225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gbg99\""
Jul 02 19:52:02.223484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.223467    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 02 19:52:02.223847 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.223831    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 02 19:52:02.236359 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.236333    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5brg5"]
Jul 02 19:52:02.281060 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.281022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.281260 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.281107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:52:02.281260 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.281154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-tmp\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.281260 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.281186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdqz\" (UniqueName: \"kubernetes.io/projected/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-kube-api-access-gfdqz\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.281473 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.281299    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ll2\" (UniqueName: \"kubernetes.io/projected/dbf9c758-f825-4cd7-a67a-c2a85b06f491-kube-api-access-45ll2\") pod \"downloads-685bfb5f64-5brg5\" (UID: \"dbf9c758-f825-4cd7-a67a-c2a85b06f491\") " pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:02.281598 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.281571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-tmp\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.283641 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.283620    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.285551 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.285537    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 02 19:52:02.293971 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.293949    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 02 19:52:02.297212 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.297193    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdqz\" (UniqueName: \"kubernetes.io/projected/7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c-kube-api-access-gfdqz\") pod \"klusterlet-addon-workmgr-6cd4c7d65c-cfpfd\" (UID: \"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.303932 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.303909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n5wp\" (UniqueName: \"kubernetes.io/projected/e0a9b261-b173-4a40-97a4-89d9fac0dc5b-kube-api-access-5n5wp\") pod \"network-check-target-d4khc\" (UID: \"e0a9b261-b173-4a40-97a4-89d9fac0dc5b\") " pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:52:02.313812 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.313791    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d8bc8c765-x6jnc"]
Jul 02 19:52:02.315815 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.315801    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.337022 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.336984    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d8bc8c765-x6jnc"]
Jul 02 19:52:02.381793 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/594c6682-42cf-4549-a216-3fe97fd2d801-ca-trust-extracted\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.381793 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/594c6682-42cf-4549-a216-3fe97fd2d801-image-registry-private-configuration\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.381793 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381771    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/594c6682-42cf-4549-a216-3fe97fd2d801-trusted-ca\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.382080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381858    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-registry-tls\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.382080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/594c6682-42cf-4549-a216-3fe97fd2d801-installation-pull-secrets\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.382080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381922    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/594c6682-42cf-4549-a216-3fe97fd2d801-registry-certificates\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.382080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381944    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45ll2\" (UniqueName: \"kubernetes.io/projected/dbf9c758-f825-4cd7-a67a-c2a85b06f491-kube-api-access-45ll2\") pod \"downloads-685bfb5f64-5brg5\" (UID: \"dbf9c758-f825-4cd7-a67a-c2a85b06f491\") " pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:02.382080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-bound-sa-token\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.382080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.381980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5hwh\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-kube-api-access-g5hwh\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.400894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.400852    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ll2\" (UniqueName: \"kubernetes.io/projected/dbf9c758-f825-4cd7-a67a-c2a85b06f491-kube-api-access-45ll2\") pod \"downloads-685bfb5f64-5brg5\" (UID: \"dbf9c758-f825-4cd7-a67a-c2a85b06f491\") " pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:02.432552 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.432509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:02.472295 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.472257    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7j2wv"
Jul 02 19:52:02.481346 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.481319    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pkjw9\""
Jul 02 19:52:02.482547 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/594c6682-42cf-4549-a216-3fe97fd2d801-trusted-ca\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.482547 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:52:02.482713 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-registry-tls\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.482713 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/594c6682-42cf-4549-a216-3fe97fd2d801-installation-pull-secrets\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.482713 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/594c6682-42cf-4549-a216-3fe97fd2d801-registry-certificates\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.482713 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-bound-sa-token\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.483062 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5hwh\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-kube-api-access-g5hwh\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.483062 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:52:02.483062 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482936    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/594c6682-42cf-4549-a216-3fe97fd2d801-ca-trust-extracted\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.483062 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.482978    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/594c6682-42cf-4549-a216-3fe97fd2d801-image-registry-private-configuration\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.483822 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.483793    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/594c6682-42cf-4549-a216-3fe97fd2d801-trusted-ca\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.484170 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.483946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/594c6682-42cf-4549-a216-3fe97fd2d801-registry-certificates\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.484285 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.484204    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/594c6682-42cf-4549-a216-3fe97fd2d801-ca-trust-extracted\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.486241 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.486059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-kmhzg\""
Jul 02 19:52:02.486345 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.486310    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"image-registry-75cf8b7f58-b6f4s\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") " pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:52:02.486690 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.486669    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c0af3202-a5d5-4e43-a9b6-60b7a0d22abc-metrics-tls\") pod \"dns-default-twpdr\" (UID: \"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc\") " pod="openshift-dns/dns-default-twpdr"
Jul 02 19:52:02.486826 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.486801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/594c6682-42cf-4549-a216-3fe97fd2d801-installation-pull-secrets\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.487303 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.487280    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-registry-tls\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.488585 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.488561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/594c6682-42cf-4549-a216-3fe97fd2d801-image-registry-private-configuration\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.488691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.488615    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7vbkc"
Jul 02 19:52:02.492265 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.492219    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-bound-sa-token\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.494689 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.494479    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:52:02.499363 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.499312    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5hwh\" (UniqueName: \"kubernetes.io/projected/594c6682-42cf-4549-a216-3fe97fd2d801-kube-api-access-g5hwh\") pod \"image-registry-6d8bc8c765-x6jnc\" (UID: \"594c6682-42cf-4549-a216-3fe97fd2d801\") " pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.529103 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.528844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:02.589823 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.586919    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"]
Jul 02 19:52:02.592490 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.592435    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba4a82c_7c33_4c6b_9bcb_6b96a5b2368c.slice/crio-827c03f927151997ef6141c1b67c698a936526bf245e6456663324fffba2b50f WatchSource:0}: Error finding container 827c03f927151997ef6141c1b67c698a936526bf245e6456663324fffba2b50f: Status 404 returned error can't find the container with id 827c03f927151997ef6141c1b67c698a936526bf245e6456663324fffba2b50f
Jul 02 19:52:02.620390 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.620274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd" event={"ID":"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c","Type":"ContainerStarted","Data":"827c03f927151997ef6141c1b67c698a936526bf245e6456663324fffba2b50f"}
Jul 02 19:52:02.620791 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.620394    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:52:02.625750 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.625708    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qbvl2\""
Jul 02 19:52:02.627657 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.627635    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:52:02.634101 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.633699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:02.640024 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.639926    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7j2wv"]
Jul 02 19:52:02.644611 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.644578    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d15d4cd_f8d6_4cbc_8169_d05382ce5729.slice/crio-56fdf97a6824990ee7ff3f5b7dcb5402a72bb9cfaeecbfe50c10581e0df13f9e WatchSource:0}: Error finding container 56fdf97a6824990ee7ff3f5b7dcb5402a72bb9cfaeecbfe50c10581e0df13f9e: Status 404 returned error can't find the container with id 56fdf97a6824990ee7ff3f5b7dcb5402a72bb9cfaeecbfe50c10581e0df13f9e
Jul 02 19:52:02.669059 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.669023    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7vbkc"]
Jul 02 19:52:02.672794 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.672764    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae816d1e_f53b_43a4_a553_cc5651a184b2.slice/crio-51f27a37ba475fe96ab9865fba1166bba55be54f311e84dd92b14eb9c0338ba5 WatchSource:0}: Error finding container 51f27a37ba475fe96ab9865fba1166bba55be54f311e84dd92b14eb9c0338ba5: Status 404 returned error can't find the container with id 51f27a37ba475fe96ab9865fba1166bba55be54f311e84dd92b14eb9c0338ba5
Jul 02 19:52:02.682060 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.682027    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-67xbm\""
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684247    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-bound-sa-token\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684295    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-ca-trust-extracted\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-image-registry-private-configuration\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684379    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bt5v\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-kube-api-access-2bt5v\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684411    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-trusted-ca\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684471    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-installation-pull-secrets\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.684503    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-certificates\") pod \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\" (UID: \"d920afa3-f62b-4b0e-8225-b40b4f9a3bc1\") "
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.685314    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.685338    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.685729    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d4khc"]
Jul 02 19:52:02.686358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.685779    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:52:02.688773 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.688734    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:52:02.688894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.688843    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:52:02.689009 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.688988    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:52:02.689069 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.689003    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:52:02.689109 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.689077    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-kube-api-access-2bt5v" (OuterVolumeSpecName: "kube-api-access-2bt5v") pod "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" (UID: "d920afa3-f62b-4b0e-8225-b40b4f9a3bc1"). InnerVolumeSpecName "kube-api-access-2bt5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:52:02.689208 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.689188    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a9b261_b173_4a40_97a4_89d9fac0dc5b.slice/crio-2a949a13c0ba67b44bba6ba99aab4d02f4664cfb805221c059d25da00dbc2f76 WatchSource:0}: Error finding container 2a949a13c0ba67b44bba6ba99aab4d02f4664cfb805221c059d25da00dbc2f76: Status 404 returned error can't find the container with id 2a949a13c0ba67b44bba6ba99aab4d02f4664cfb805221c059d25da00dbc2f76
Jul 02 19:52:02.690175 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.690159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twpdr"
Jul 02 19:52:02.705732 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.705702    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-5brg5"]
Jul 02 19:52:02.711619 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.711588    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf9c758_f825_4cd7_a67a_c2a85b06f491.slice/crio-ee9c581e4088749547456971bfc612dc4c6d224d3dd902a29ce3415038b50c78 WatchSource:0}: Error finding container ee9c581e4088749547456971bfc612dc4c6d224d3dd902a29ce3415038b50c78: Status 404 returned error can't find the container with id ee9c581e4088749547456971bfc612dc4c6d224d3dd902a29ce3415038b50c78
Jul 02 19:52:02.785823 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785792    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d8bc8c765-x6jnc"]
Jul 02 19:52:02.785823 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785815    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-bound-sa-token\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785842    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-ca-trust-extracted\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785857    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-image-registry-private-configuration\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785888    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bt5v\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-kube-api-access-2bt5v\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785903    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785916    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-trusted-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785928    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-installation-pull-secrets\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.786018 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.785941    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1-registry-certificates\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:02.789243 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.789211    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594c6682_42cf_4549_a216_3fe97fd2d801.slice/crio-56ec72d52ccaec55abfd6e8c8467feb2e755e8257a22f4083fd2187f9e65886d WatchSource:0}: Error finding container 56ec72d52ccaec55abfd6e8c8467feb2e755e8257a22f4083fd2187f9e65886d: Status 404 returned error can't find the container with id 56ec72d52ccaec55abfd6e8c8467feb2e755e8257a22f4083fd2187f9e65886d
Jul 02 19:52:02.833198 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:02.833167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-twpdr"]
Jul 02 19:52:02.836976 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:02.836943    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0af3202_a5d5_4e43_a9b6_60b7a0d22abc.slice/crio-784f7023593afe1b52a5a656afd243880861d9c292add4beae299c0036560c67 WatchSource:0}: Error finding container 784f7023593afe1b52a5a656afd243880861d9c292add4beae299c0036560c67: Status 404 returned error can't find the container with id 784f7023593afe1b52a5a656afd243880861d9c292add4beae299c0036560c67
Jul 02 19:52:03.635117 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.632476    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc" event={"ID":"594c6682-42cf-4549-a216-3fe97fd2d801","Type":"ContainerStarted","Data":"76eb0e3e4f7a805ea350f4b41e89159d1f98a0bd60fbd03ccb9ee5cbcc99d780"}
Jul 02 19:52:03.635117 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.632573    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc" event={"ID":"594c6682-42cf-4549-a216-3fe97fd2d801","Type":"ContainerStarted","Data":"56ec72d52ccaec55abfd6e8c8467feb2e755e8257a22f4083fd2187f9e65886d"}
Jul 02 19:52:03.635117 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.632853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:03.635117 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.634344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vbkc" event={"ID":"ae816d1e-f53b-43a4-a553-cc5651a184b2","Type":"ContainerStarted","Data":"51f27a37ba475fe96ab9865fba1166bba55be54f311e84dd92b14eb9c0338ba5"}
Jul 02 19:52:03.639761 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.639690    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7j2wv" event={"ID":"5d15d4cd-f8d6-4cbc-8169-d05382ce5729","Type":"ContainerStarted","Data":"56fdf97a6824990ee7ff3f5b7dcb5402a72bb9cfaeecbfe50c10581e0df13f9e"}
Jul 02 19:52:03.641937 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.641907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twpdr" event={"ID":"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc","Type":"ContainerStarted","Data":"784f7023593afe1b52a5a656afd243880861d9c292add4beae299c0036560c67"}
Jul 02 19:52:03.644170 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.644119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5brg5" event={"ID":"dbf9c758-f825-4cd7-a67a-c2a85b06f491","Type":"ContainerStarted","Data":"ee9c581e4088749547456971bfc612dc4c6d224d3dd902a29ce3415038b50c78"}
Jul 02 19:52:03.645811 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.645754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75cf8b7f58-b6f4s"
Jul 02 19:52:03.646189 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.646156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d4khc" event={"ID":"e0a9b261-b173-4a40-97a4-89d9fac0dc5b","Type":"ContainerStarted","Data":"2a949a13c0ba67b44bba6ba99aab4d02f4664cfb805221c059d25da00dbc2f76"}
Jul 02 19:52:03.659710 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.659495    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc" podStartSLOduration=1.659474197 podStartE2EDuration="1.659474197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:03.65728518 +0000 UTC m=+67.952167718" watchObservedRunningTime="2026-07-02 19:52:03.659474197 +0000 UTC m=+67.954356711"
Jul 02 19:52:03.688143 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.686381    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-75cf8b7f58-b6f4s"]
Jul 02 19:52:03.688143 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:03.688088    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-75cf8b7f58-b6f4s"]
Jul 02 19:52:04.148894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.148846    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"]
Jul 02 19:52:04.162895 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.162768    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"]
Jul 02 19:52:04.163604 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.162922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:04.165734 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.165526    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 02 19:52:04.165908 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.165809    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bx75x\""
Jul 02 19:52:04.264799 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.264565    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d920afa3-f62b-4b0e-8225-b40b4f9a3bc1" path="/var/lib/kubelet/pods/d920afa3-f62b-4b0e-8225-b40b4f9a3bc1/volumes"
Jul 02 19:52:04.300735 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.300620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zkz6c\" (UID: \"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:04.401910 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.401332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zkz6c\" (UID: \"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:04.401910 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:04.401538    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:52:04.401910 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:04.401608    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates podName:1e8fea2f-35c8-4814-a6ba-d35d0372b5cf nodeName:}" failed. No retries permitted until 2026-07-02 19:52:04.901585078 +0000 UTC m=+69.196467569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-zkz6c" (UID: "1e8fea2f-35c8-4814-a6ba-d35d0372b5cf") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:52:04.654593 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.654479    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vbkc" event={"ID":"ae816d1e-f53b-43a4-a553-cc5651a184b2","Type":"ContainerStarted","Data":"5c9184bed2f4624679ab565493e16b4fce5772c96042f10a8abe0ee3d8aae55c"}
Jul 02 19:52:04.908127 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:04.907367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zkz6c\" (UID: \"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:04.908127 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:04.907527    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:52:04.908127 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:04.907631    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates podName:1e8fea2f-35c8-4814-a6ba-d35d0372b5cf nodeName:}" failed. No retries permitted until 2026-07-02 19:52:05.907606421 +0000 UTC m=+70.202488913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-zkz6c" (UID: "1e8fea2f-35c8-4814-a6ba-d35d0372b5cf") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 02 19:52:05.664673 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:05.663766    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7vbkc" event={"ID":"ae816d1e-f53b-43a4-a553-cc5651a184b2","Type":"ContainerStarted","Data":"b3af26e485f536505201292c5e15268a0648eab0521c6ff720751d18a93be5eb"}
Jul 02 19:52:05.683477 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:05.683264    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7vbkc" podStartSLOduration=68.153959201 podStartE2EDuration="1m9.683208731s" totalImagesPullingTime="1.52924953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:05.682114843 +0000 UTC m=+69.976997370" watchObservedRunningTime="2026-07-02 19:52:05.683208731 +0000 UTC m=+69.978091248"
Jul 02 19:52:05.917919 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:05.917367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zkz6c\" (UID: \"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:05.928268 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:05.928236    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1e8fea2f-35c8-4814-a6ba-d35d0372b5cf-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-zkz6c\" (UID: \"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:05.977049 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:05.977004    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:06.198044 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:06.197912    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"]
Jul 02 19:52:07.014540 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:07.014492    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e8fea2f_35c8_4814_a6ba_d35d0372b5cf.slice/crio-9401f6fe9f91ac2f9a1e3d8d51eded09f806cca8aa3d7c2dc96449e2ad6d6acb WatchSource:0}: Error finding container 9401f6fe9f91ac2f9a1e3d8d51eded09f806cca8aa3d7c2dc96449e2ad6d6acb: Status 404 returned error can't find the container with id 9401f6fe9f91ac2f9a1e3d8d51eded09f806cca8aa3d7c2dc96449e2ad6d6acb
Jul 02 19:52:07.675010 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:07.674956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c" event={"ID":"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf","Type":"ContainerStarted","Data":"9401f6fe9f91ac2f9a1e3d8d51eded09f806cca8aa3d7c2dc96449e2ad6d6acb"}
Jul 02 19:52:08.105943 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.105731    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6995fd47c4-l5g8t"]
Jul 02 19:52:08.109158 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.109126    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.111848 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.111815    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 02 19:52:08.111848 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.111841    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 02 19:52:08.112161 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.112143    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-47pv8\""
Jul 02 19:52:08.112901 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.112851    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 02 19:52:08.113275 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.113176    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 02 19:52:08.113275 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.113207    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 02 19:52:08.120497 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.120438    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6995fd47c4-l5g8t"]
Jul 02 19:52:08.238248 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.238207    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spfbx\" (UniqueName: \"kubernetes.io/projected/acec302a-3e69-4b22-b463-469276b589f7-kube-api-access-spfbx\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.238422 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.238266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-serving-cert\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.238422 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.238318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-oauth-serving-cert\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.238512 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.238451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-service-ca\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.238512 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.238489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-console-config\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.238626 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.238557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-oauth-config\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.339212 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.339157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-oauth-config\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.339212 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.339213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spfbx\" (UniqueName: \"kubernetes.io/projected/acec302a-3e69-4b22-b463-469276b589f7-kube-api-access-spfbx\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.339461 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.339249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-serving-cert\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.339684 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.339586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-oauth-serving-cert\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.339809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.339693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-service-ca\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.339809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.339723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-console-config\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.340360 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.340331    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-oauth-serving-cert\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.340481 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.340335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-service-ca\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.340481 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.340422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-console-config\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.342228 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.342202    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-serving-cert\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.343165 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.343140    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-oauth-config\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.348338 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.348315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spfbx\" (UniqueName: \"kubernetes.io/projected/acec302a-3e69-4b22-b463-469276b589f7-kube-api-access-spfbx\") pod \"console-6995fd47c4-l5g8t\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") " pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:08.421214 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:08.421134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:12.332659 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.332615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6995fd47c4-l5g8t"]
Jul 02 19:52:12.338641 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:12.338550    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacec302a_3e69_4b22_b463_469276b589f7.slice/crio-6f4b32653766ca9df445ee5812771efcc2c14fecc40d289874facefd356b7f0d WatchSource:0}: Error finding container 6f4b32653766ca9df445ee5812771efcc2c14fecc40d289874facefd356b7f0d: Status 404 returned error can't find the container with id 6f4b32653766ca9df445ee5812771efcc2c14fecc40d289874facefd356b7f0d
Jul 02 19:52:12.696920 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.696634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twpdr" event={"ID":"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc","Type":"ContainerStarted","Data":"e1248ef50e5b7ae2fa9bd0b5da8e12b69c46daa1012c3b724d8187c2c2816e09"}
Jul 02 19:52:12.696920 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.696702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twpdr" event={"ID":"c0af3202-a5d5-4e43-a9b6-60b7a0d22abc","Type":"ContainerStarted","Data":"3e300bdea842bc857fea412e20855de97e4de0ea010346a9871df739ed97ff9e"}
Jul 02 19:52:12.696920 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.696731    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-twpdr"
Jul 02 19:52:12.700652 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.700621    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d4khc" event={"ID":"e0a9b261-b173-4a40-97a4-89d9fac0dc5b","Type":"ContainerStarted","Data":"46bfa8d26b69376b397abbb5e9782f1d6f09006f12540ca71cafd01daf473d26"}
Jul 02 19:52:12.701173 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.700678    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:52:12.702235 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.702209    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995fd47c4-l5g8t" event={"ID":"acec302a-3e69-4b22-b463-469276b589f7","Type":"ContainerStarted","Data":"6f4b32653766ca9df445ee5812771efcc2c14fecc40d289874facefd356b7f0d"}
Jul 02 19:52:12.703815 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.703755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd" event={"ID":"7ba4a82c-7c33-4c6b-9bcb-6b96a5b2368c","Type":"ContainerStarted","Data":"e8679927e4119105df18ac5d8d65b3b3912e7c14f30cb6ecad2f5bb4b6e070b0"}
Jul 02 19:52:12.703974 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.703912    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:12.705598 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.705548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7j2wv" event={"ID":"5d15d4cd-f8d6-4cbc-8169-d05382ce5729","Type":"ContainerStarted","Data":"6d2982fb67146fe2e64dbab4005484bea608f05ba3b8cef81aee574ccf5039b7"}
Jul 02 19:52:12.706086 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.706058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd"
Jul 02 19:52:12.707387 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.707366    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c" event={"ID":"1e8fea2f-35c8-4814-a6ba-d35d0372b5cf","Type":"ContainerStarted","Data":"65a0a34dee52b8111aa40707f5f40192b9d1b97018ff1290f6dcfb4b1588be0e"}
Jul 02 19:52:12.707609 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.707584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:12.714184 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.714052    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-twpdr" podStartSLOduration=33.384686414 podStartE2EDuration="42.714030023s" totalImagesPullingTime="9.329343609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:51:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:12.714009056 +0000 UTC m=+77.008891569" watchObservedRunningTime="2026-07-02 19:52:12.714030023 +0000 UTC m=+77.008912537"
Jul 02 19:52:12.714381 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.714334    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c"
Jul 02 19:52:12.736457 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.736386    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-zkz6c" podStartSLOduration=3.524691519 podStartE2EDuration="8.736364407s" totalImagesPullingTime="5.211672888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:12.735445616 +0000 UTC m=+77.030328131" watchObservedRunningTime="2026-07-02 19:52:12.736364407 +0000 UTC m=+77.031246925"
Jul 02 19:52:12.777326 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.777277    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd4c7d65c-cfpfd" podStartSLOduration=1.204711989 podStartE2EDuration="10.777258075s" totalImagesPullingTime="9.572546086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:12.77712029 +0000 UTC m=+77.072002804" watchObservedRunningTime="2026-07-02 19:52:12.777258075 +0000 UTC m=+77.072140588"
Jul 02 19:52:12.777583 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.777554    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d4khc" podStartSLOduration=67.302472514 podStartE2EDuration="1m16.777546424s" totalImagesPullingTime="9.47507391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:12.75537215 +0000 UTC m=+77.050254664" watchObservedRunningTime="2026-07-02 19:52:12.777546424 +0000 UTC m=+77.072428936"
Jul 02 19:52:12.792531 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:12.792476    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7j2wv" podStartSLOduration=67.269488956 podStartE2EDuration="1m16.79245975s" totalImagesPullingTime="9.522970794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:50:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:12.79189139 +0000 UTC m=+77.086773910" watchObservedRunningTime="2026-07-02 19:52:12.79245975 +0000 UTC m=+77.087342281"
Jul 02 19:52:13.208176 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.208139    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"]
Jul 02 19:52:13.211594 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.211569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.214610 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.214584    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 02 19:52:13.214844 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.214812    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 02 19:52:13.215161 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.215138    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 02 19:52:13.215244 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.215202    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 02 19:52:13.215244 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.215200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m6trr\""
Jul 02 19:52:13.215579 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.215563    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 02 19:52:13.222611 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.222586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"]
Jul 02 19:52:13.280762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.280589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/602a21b0-4f28-4575-ae93-35b80f9456b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.280762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.280652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602a21b0-4f28-4575-ae93-35b80f9456b7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.280762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.280697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c95dm\" (UniqueName: \"kubernetes.io/projected/602a21b0-4f28-4575-ae93-35b80f9456b7-kube-api-access-c95dm\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.280762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.280755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/602a21b0-4f28-4575-ae93-35b80f9456b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.382094 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.382056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602a21b0-4f28-4575-ae93-35b80f9456b7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.382551 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.382116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c95dm\" (UniqueName: \"kubernetes.io/projected/602a21b0-4f28-4575-ae93-35b80f9456b7-kube-api-access-c95dm\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.382551 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.382199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/602a21b0-4f28-4575-ae93-35b80f9456b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.382551 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.382268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/602a21b0-4f28-4575-ae93-35b80f9456b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.383219 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.383171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/602a21b0-4f28-4575-ae93-35b80f9456b7-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.385265 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.385238    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/602a21b0-4f28-4575-ae93-35b80f9456b7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.385832 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.385814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/602a21b0-4f28-4575-ae93-35b80f9456b7-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.391123 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.391095    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c95dm\" (UniqueName: \"kubernetes.io/projected/602a21b0-4f28-4575-ae93-35b80f9456b7-kube-api-access-c95dm\") pod \"prometheus-operator-567f7b8b7c-7jjck\" (UID: \"602a21b0-4f28-4575-ae93-35b80f9456b7\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.525986 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.525953    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"
Jul 02 19:52:13.686119 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.686064    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck"]
Jul 02 19:52:13.689596 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:13.689565    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602a21b0_4f28_4575_ae93_35b80f9456b7.slice/crio-16374ac4ef1427a94dde22fe0de95c0204e407a8f8d71d1731b091fc857728a2 WatchSource:0}: Error finding container 16374ac4ef1427a94dde22fe0de95c0204e407a8f8d71d1731b091fc857728a2: Status 404 returned error can't find the container with id 16374ac4ef1427a94dde22fe0de95c0204e407a8f8d71d1731b091fc857728a2
Jul 02 19:52:13.714049 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:13.713942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck" event={"ID":"602a21b0-4f28-4575-ae93-35b80f9456b7","Type":"ContainerStarted","Data":"16374ac4ef1427a94dde22fe0de95c0204e407a8f8d71d1731b091fc857728a2"}
Jul 02 19:52:22.718787 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:22.718664    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-twpdr"
Jul 02 19:52:24.660006 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.659967    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d8bc8c765-x6jnc"
Jul 02 19:52:24.765290 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.765225    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-5brg5" event={"ID":"dbf9c758-f825-4cd7-a67a-c2a85b06f491","Type":"ContainerStarted","Data":"da6530016196fa444837ccd2604ae5c3159d4176e5bd3ffe15750f76a4695481"}
Jul 02 19:52:24.765506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.765438    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:24.767626 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.767581    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995fd47c4-l5g8t" event={"ID":"acec302a-3e69-4b22-b463-469276b589f7","Type":"ContainerStarted","Data":"3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3"}
Jul 02 19:52:24.769766 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.769729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck" event={"ID":"602a21b0-4f28-4575-ae93-35b80f9456b7","Type":"ContainerStarted","Data":"8506126ddc11f8e098c00aa3269e3aad2a0d2094362ef946da6bb58fecff2623"}
Jul 02 19:52:24.769944 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.769794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck" event={"ID":"602a21b0-4f28-4575-ae93-35b80f9456b7","Type":"ContainerStarted","Data":"1d6fca139077866f1c22b8c3216d103e09f5f7a1430079cbbbaaf767b1e7ac7a"}
Jul 02 19:52:24.778167 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.778139    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-5brg5"
Jul 02 19:52:24.785035 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.784972    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-5brg5" podStartSLOduration=1.7213058079999999 podStartE2EDuration="22.784951543s" totalImagesPullingTime="21.063645735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:24.78353394 +0000 UTC m=+89.078416465" watchObservedRunningTime="2026-07-02 19:52:24.784951543 +0000 UTC m=+89.079834056"
Jul 02 19:52:24.818201 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.818136    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-7jjck" podStartSLOduration=1.7818562199999999 podStartE2EDuration="11.818114333s" totalImagesPullingTime="10.036258113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:24.816475756 +0000 UTC m=+89.111358279" watchObservedRunningTime="2026-07-02 19:52:24.818114333 +0000 UTC m=+89.112996848"
Jul 02 19:52:24.834789 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:24.834731    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6995fd47c4-l5g8t" podStartSLOduration=5.447970718 podStartE2EDuration="16.834713583s" totalImagesPullingTime="11.386742865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:24.833626262 +0000 UTC m=+89.128508778" watchObservedRunningTime="2026-07-02 19:52:24.834713583 +0000 UTC m=+89.129596095"
Jul 02 19:52:26.589850 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.589814    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"]
Jul 02 19:52:26.619935 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.619902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"]
Jul 02 19:52:26.620302 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.620288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.623734 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.623658    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 02 19:52:26.625325 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.625303    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 02 19:52:26.625739 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.625548    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-62sj4\""
Jul 02 19:52:26.637837 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.637804    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fs599"]
Jul 02 19:52:26.654939 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.654909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.658059 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.658028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 02 19:52:26.658501 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.658476    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2q68n\""
Jul 02 19:52:26.658967 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.658949    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 02 19:52:26.659510 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.659493    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 02 19:52:26.792418 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a343bf67-bcdb-4183-83df-1a19ee020cd7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.792603 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a343bf67-bcdb-4183-83df-1a19ee020cd7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.792603 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-sys\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.792603 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg25m\" (UniqueName: \"kubernetes.io/projected/a343bf67-bcdb-4183-83df-1a19ee020cd7-kube-api-access-qg25m\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.792603 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-accelerators-collector-config\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.792809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792606    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a343bf67-bcdb-4183-83df-1a19ee020cd7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.792809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-tls\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.792809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792681    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.792809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-root\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.792809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-wtmp\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.792809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7346a83-9ce2-48c1-bfdc-f6589fb61772-metrics-client-ca\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.793107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jv9gk\" (UniqueName: \"kubernetes.io/projected/d7346a83-9ce2-48c1-bfdc-f6589fb61772-kube-api-access-jv9gk\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.793107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.792939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-textfile\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.893784 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7346a83-9ce2-48c1-bfdc-f6589fb61772-metrics-client-ca\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.893784 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893753    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jv9gk\" (UniqueName: \"kubernetes.io/projected/d7346a83-9ce2-48c1-bfdc-f6589fb61772-kube-api-access-jv9gk\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.893784 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-textfile\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a343bf67-bcdb-4183-83df-1a19ee020cd7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a343bf67-bcdb-4183-83df-1a19ee020cd7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-sys\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg25m\" (UniqueName: \"kubernetes.io/projected/a343bf67-bcdb-4183-83df-1a19ee020cd7-kube-api-access-qg25m\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893974    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-accelerators-collector-config\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.893999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a343bf67-bcdb-4183-83df-1a19ee020cd7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894025    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-tls\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894107 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894493 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-root\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894493 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-wtmp\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894493 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-wtmp\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894493 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7346a83-9ce2-48c1-bfdc-f6589fb61772-metrics-client-ca\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894687 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894600    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-accelerators-collector-config\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.894687 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894671    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-sys\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.895010 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.894985    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-textfile\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.895275 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.895250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a343bf67-bcdb-4183-83df-1a19ee020cd7-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.895382 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.895353    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d7346a83-9ce2-48c1-bfdc-f6589fb61772-root\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.898005 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.897978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.898929 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.898653    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a343bf67-bcdb-4183-83df-1a19ee020cd7-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.898929 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.898784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a343bf67-bcdb-4183-83df-1a19ee020cd7-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.899203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.899185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d7346a83-9ce2-48c1-bfdc-f6589fb61772-node-exporter-tls\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.908193 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.908162    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jv9gk\" (UniqueName: \"kubernetes.io/projected/d7346a83-9ce2-48c1-bfdc-f6589fb61772-kube-api-access-jv9gk\") pod \"node-exporter-fs599\" (UID: \"d7346a83-9ce2-48c1-bfdc-f6589fb61772\") " pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:26.911284 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.911261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg25m\" (UniqueName: \"kubernetes.io/projected/a343bf67-bcdb-4183-83df-1a19ee020cd7-kube-api-access-qg25m\") pod \"openshift-state-metrics-54cf96dfcf-4f44m\" (UID: \"a343bf67-bcdb-4183-83df-1a19ee020cd7\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.941765 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.941725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"
Jul 02 19:52:26.968663 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:26.968620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fs599"
Jul 02 19:52:27.149381 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.149284    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m"]
Jul 02 19:52:27.152946 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:27.152918    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda343bf67_bcdb_4183_83df_1a19ee020cd7.slice/crio-2e9c37ed027d9b215c643fe702d09752588ddbcbacfd28fcab5cd28ae5ad314c WatchSource:0}: Error finding container 2e9c37ed027d9b215c643fe702d09752588ddbcbacfd28fcab5cd28ae5ad314c: Status 404 returned error can't find the container with id 2e9c37ed027d9b215c643fe702d09752588ddbcbacfd28fcab5cd28ae5ad314c
Jul 02 19:52:27.494117 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.494073    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6995fd47c4-l5g8t"]
Jul 02 19:52:27.727560 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.727327    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:52:27.753646 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.752265    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:52:27.753646 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.752442    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.756440 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.756412    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 19:52:27.756670 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.756653    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 19:52:27.756845 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.756829    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 19:52:27.757114 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.757097    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 19:52:27.757374 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.757354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-prp4p\""
Jul 02 19:52:27.757548 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.757533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 19:52:27.757757 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.757710    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 19:52:27.757952 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.757936    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 19:52:27.758139 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.758124    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 19:52:27.759381 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.759357    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 19:52:27.790683 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.788083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m" event={"ID":"a343bf67-bcdb-4183-83df-1a19ee020cd7","Type":"ContainerStarted","Data":"a5353ffb5ba755c6057c67c05ac518664708cfb5575a47b174b46c5c5f1edcb0"}
Jul 02 19:52:27.790683 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.788177    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m" event={"ID":"a343bf67-bcdb-4183-83df-1a19ee020cd7","Type":"ContainerStarted","Data":"c789dd5c252195d3c5dcd95c440e081d9a215cc2bbd637e96a71367e3fdbbdca"}
Jul 02 19:52:27.790683 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.788212    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m" event={"ID":"a343bf67-bcdb-4183-83df-1a19ee020cd7","Type":"ContainerStarted","Data":"2e9c37ed027d9b215c643fe702d09752588ddbcbacfd28fcab5cd28ae5ad314c"}
Jul 02 19:52:27.791108 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.791030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fs599" event={"ID":"d7346a83-9ce2-48c1-bfdc-f6589fb61772","Type":"ContainerStarted","Data":"3211023abfec39a824b70f4595ee7375c8f7900009913e14aef4d37d012f8bf0"}
Jul 02 19:52:27.902482 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-web-config\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902551    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902694    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-config-out\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.902840 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfkz4\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-kube-api-access-sfkz4\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:27.903132 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:27.902871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-web-config\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004593    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004617    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-config-out\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004641    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:28.004702    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.004765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkz4\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-kube-api-access-sfkz4\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.005508 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:28.004783    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls podName:0b228489-9f01-4c5c-89b7-1c025c69041a nodeName:}" failed. No retries permitted until 2026-07-02 19:52:28.504761865 +0000 UTC m=+92.799644360 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a") : secret "alertmanager-main-tls" not found
Jul 02 19:52:28.006421 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.005819    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.007506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.007199    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.007506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.007389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.011914 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.011417    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.012376 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.012348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.012977 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.012936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.013905 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.013868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-config-out\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.014711 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.014670    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-config-volume\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.014711 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.014693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.015859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.015820    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfkz4\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-kube-api-access-sfkz4\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.017313 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.017276    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.018805 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.018712    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-web-config\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.422352 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.422263    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:28.510094 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:28.510056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:28.510304 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:28.510253    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 02 19:52:28.510366 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:28.510333    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls podName:0b228489-9f01-4c5c-89b7-1c025c69041a nodeName:}" failed. No retries permitted until 2026-07-02 19:52:29.510311605 +0000 UTC m=+93.805194114 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a") : secret "alertmanager-main-tls" not found
Jul 02 19:52:29.520667 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.520630    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:29.523846 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.523823    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:29.572384 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.572343    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:52:29.799625 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.799230    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:52:29.806991 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.806953    2562 generic.go:356] "Generic (PLEG): container finished" podID="d7346a83-9ce2-48c1-bfdc-f6589fb61772" containerID="a14827e3902463c954ca5aa09fc36f33ba760787ea56902fe1225511921b735e" exitCode=0
Jul 02 19:52:29.807124 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.807104    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fs599" event={"ID":"d7346a83-9ce2-48c1-bfdc-f6589fb61772","Type":"ContainerDied","Data":"a14827e3902463c954ca5aa09fc36f33ba760787ea56902fe1225511921b735e"}
Jul 02 19:52:29.812848 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.812680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m" event={"ID":"a343bf67-bcdb-4183-83df-1a19ee020cd7","Type":"ContainerStarted","Data":"abd0fbfb47e82d88287637ede435b7fe853e42a4e1d292cd684947ed1b28f612"}
Jul 02 19:52:29.864127 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:29.863383    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-4f44m" podStartSLOduration=1.7780203829999999 podStartE2EDuration="3.863359186s" totalImagesPullingTime="2.085338803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:29.862534995 +0000 UTC m=+94.157417506" watchObservedRunningTime="2026-07-02 19:52:29.863359186 +0000 UTC m=+94.158241700"
Jul 02 19:52:30.818659 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:30.818618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"3b655fada0221111ddf67c2a02087ca54394336a0deab768226f993b6a6818b9"}
Jul 02 19:52:30.821278 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:30.821250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fs599" event={"ID":"d7346a83-9ce2-48c1-bfdc-f6589fb61772","Type":"ContainerStarted","Data":"5926f808dd9d08720f29be884e1d7ae5b3bb4fb39c103bdb8805cadb36997c28"}
Jul 02 19:52:30.821396 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:30.821306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fs599" event={"ID":"d7346a83-9ce2-48c1-bfdc-f6589fb61772","Type":"ContainerStarted","Data":"3d2602793bab785c2db2601acb671ac11dea5a460fd1af123b268e1f470e166c"}
Jul 02 19:52:30.841727 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:30.841668    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fs599" podStartSLOduration=2.569846316 podStartE2EDuration="4.841647043s" totalImagesPullingTime="2.154798415s" totalInitContainerRuntime="117.002312ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:52:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:30.840703166 +0000 UTC m=+95.135585699" watchObservedRunningTime="2026-07-02 19:52:30.841647043 +0000 UTC m=+95.136529558"
Jul 02 19:52:31.103601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.103411    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8665f9f9d8-ptf42"]
Jul 02 19:52:31.138324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.138280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8665f9f9d8-ptf42"]
Jul 02 19:52:31.138520 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.138431    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.141098 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.141063    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 02 19:52:31.141286 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.141086    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 02 19:52:31.141465 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.141401    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 02 19:52:31.142061 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.142023    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 02 19:52:31.142268 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.142115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h5ksb\""
Jul 02 19:52:31.142268 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.142028    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4g6vtlec89ac3\""
Jul 02 19:52:31.237578 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237537    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm74m\" (UniqueName: \"kubernetes.io/projected/3c71d76c-36d4-4102-aaf7-f2c332986222-kube-api-access-cm74m\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.237763 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-client-ca-bundle\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.237763 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3c71d76c-36d4-4102-aaf7-f2c332986222-audit-log\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.237763 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c71d76c-36d4-4102-aaf7-f2c332986222-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.237763 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-secret-metrics-server-client-certs\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.237763 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3c71d76c-36d4-4102-aaf7-f2c332986222-metrics-server-audit-profiles\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.238005 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.237811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-secret-metrics-server-tls\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c71d76c-36d4-4102-aaf7-f2c332986222-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339444 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339248    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-secret-metrics-server-client-certs\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339444 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339303    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3c71d76c-36d4-4102-aaf7-f2c332986222-metrics-server-audit-profiles\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339444 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-secret-metrics-server-tls\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339444 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm74m\" (UniqueName: \"kubernetes.io/projected/3c71d76c-36d4-4102-aaf7-f2c332986222-kube-api-access-cm74m\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339444 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-client-ca-bundle\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.339700 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.339464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3c71d76c-36d4-4102-aaf7-f2c332986222-audit-log\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.340205 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.340124    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c71d76c-36d4-4102-aaf7-f2c332986222-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.340533 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.340373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3c71d76c-36d4-4102-aaf7-f2c332986222-audit-log\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.340754 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.340718    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3c71d76c-36d4-4102-aaf7-f2c332986222-metrics-server-audit-profiles\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.342494 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.342468    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-secret-metrics-server-client-certs\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.342925 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.342858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-secret-metrics-server-tls\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.343025 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.342922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3c71d76c-36d4-4102-aaf7-f2c332986222-client-ca-bundle\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.354772 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.354703    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm74m\" (UniqueName: \"kubernetes.io/projected/3c71d76c-36d4-4102-aaf7-f2c332986222-kube-api-access-cm74m\") pod \"metrics-server-8665f9f9d8-ptf42\" (UID: \"3c71d76c-36d4-4102-aaf7-f2c332986222\") " pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.365698 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.365664    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"]
Jul 02 19:52:31.386337 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.386305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"]
Jul 02 19:52:31.386514 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.386433    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:31.389224 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.388935    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 02 19:52:31.389224 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.388970    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pwlhr\""
Jul 02 19:52:31.450942 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.450895    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:31.541550 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.541512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnz4f\" (UniqueName: \"kubernetes.io/projected/98cdd854-b9f3-45d6-899a-639e7abe774b-kube-api-access-cnz4f\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:31.541721 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.541563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98cdd854-b9f3-45d6-899a-639e7abe774b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:31.642839 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.642796    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnz4f\" (UniqueName: \"kubernetes.io/projected/98cdd854-b9f3-45d6-899a-639e7abe774b-kube-api-access-cnz4f\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:31.643043 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.642859    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98cdd854-b9f3-45d6-899a-639e7abe774b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:31.643043 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:31.643026    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 02 19:52:31.643177 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:31.643108    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98cdd854-b9f3-45d6-899a-639e7abe774b-monitoring-plugin-cert podName:98cdd854-b9f3-45d6-899a-639e7abe774b nodeName:}" failed. No retries permitted until 2026-07-02 19:52:32.143075541 +0000 UTC m=+96.437958032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/98cdd854-b9f3-45d6-899a-639e7abe774b-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-7rn54" (UID: "98cdd854-b9f3-45d6-899a-639e7abe774b") : secret "monitoring-plugin-cert" not found
Jul 02 19:52:31.655561 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.655261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnz4f\" (UniqueName: \"kubernetes.io/projected/98cdd854-b9f3-45d6-899a-639e7abe774b-kube-api-access-cnz4f\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:31.709825 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.709252    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d9c874499-fcxts"]
Jul 02 19:52:31.753591 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.752969    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9c874499-fcxts"]
Jul 02 19:52:31.753591 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.753120    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.767246 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.767109    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 02 19:52:31.781304 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.781257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8665f9f9d8-ptf42"]
Jul 02 19:52:31.784114 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:31.784083    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c71d76c_36d4_4102_aaf7_f2c332986222.slice/crio-6dbd907fd09428e2174873e118ea953662f2f0cf6830ad23de3a2f73d1425cbd WatchSource:0}: Error finding container 6dbd907fd09428e2174873e118ea953662f2f0cf6830ad23de3a2f73d1425cbd: Status 404 returned error can't find the container with id 6dbd907fd09428e2174873e118ea953662f2f0cf6830ad23de3a2f73d1425cbd
Jul 02 19:52:31.826593 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.826558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42" event={"ID":"3c71d76c-36d4-4102-aaf7-f2c332986222","Type":"ContainerStarted","Data":"6dbd907fd09428e2174873e118ea953662f2f0cf6830ad23de3a2f73d1425cbd"}
Jul 02 19:52:31.828529 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.828497    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051" exitCode=0
Jul 02 19:52:31.828644 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.828583    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"}
Jul 02 19:52:31.946403 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.946318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-serving-cert\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.946725 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.946708    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-oauth-config\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.946834 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.946821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-config\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.946986 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.946963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-service-ca\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.947225 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.947208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-oauth-serving-cert\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.947293 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.947263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-trusted-ca-bundle\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:31.947352 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:31.947292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjnpv\" (UniqueName: \"kubernetes.io/projected/52af0cf8-7cb7-4473-9e0e-78a2608d2098-kube-api-access-bjnpv\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048074 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-oauth-serving-cert\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048074 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-trusted-ca-bundle\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048348 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjnpv\" (UniqueName: \"kubernetes.io/projected/52af0cf8-7cb7-4473-9e0e-78a2608d2098-kube-api-access-bjnpv\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048348 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-serving-cert\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048348 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048294    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-oauth-config\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048348 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-config\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.048575 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-service-ca\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.049301 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.048946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-oauth-serving-cert\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.049301 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.049233    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-config\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.049301 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.049246    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-service-ca\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.049636 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.049614    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-trusted-ca-bundle\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.052021 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.051992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-serving-cert\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.052136 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.052038    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-oauth-config\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.056818 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.056792    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjnpv\" (UniqueName: \"kubernetes.io/projected/52af0cf8-7cb7-4473-9e0e-78a2608d2098-kube-api-access-bjnpv\") pod \"console-6d9c874499-fcxts\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") " pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.066382 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.066342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:32.149762 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.149723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98cdd854-b9f3-45d6-899a-639e7abe774b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:32.153250 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.153197    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/98cdd854-b9f3-45d6-899a-639e7abe774b-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7rn54\" (UID: \"98cdd854-b9f3-45d6-899a-639e7abe774b\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:32.249696 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.249663    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9c874499-fcxts"]
Jul 02 19:52:32.252564 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:32.252531    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52af0cf8_7cb7_4473_9e0e_78a2608d2098.slice/crio-212f6278bd95b67ac247edec4b4611aa98da1a8edc4205dabc26218a5565d600 WatchSource:0}: Error finding container 212f6278bd95b67ac247edec4b4611aa98da1a8edc4205dabc26218a5565d600: Status 404 returned error can't find the container with id 212f6278bd95b67ac247edec4b4611aa98da1a8edc4205dabc26218a5565d600
Jul 02 19:52:32.298728 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.298698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:32.500510 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.500378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"]
Jul 02 19:52:32.506394 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:32.506359    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cdd854_b9f3_45d6_899a_639e7abe774b.slice/crio-871e11286c962bbb6b3516c990b64e80e32e8ef9d37ef11d54d64880ac8799b1 WatchSource:0}: Error finding container 871e11286c962bbb6b3516c990b64e80e32e8ef9d37ef11d54d64880ac8799b1: Status 404 returned error can't find the container with id 871e11286c962bbb6b3516c990b64e80e32e8ef9d37ef11d54d64880ac8799b1
Jul 02 19:52:32.843098 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.842909    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c874499-fcxts" event={"ID":"52af0cf8-7cb7-4473-9e0e-78a2608d2098","Type":"ContainerStarted","Data":"32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192"}
Jul 02 19:52:32.843098 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.843020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c874499-fcxts" event={"ID":"52af0cf8-7cb7-4473-9e0e-78a2608d2098","Type":"ContainerStarted","Data":"212f6278bd95b67ac247edec4b4611aa98da1a8edc4205dabc26218a5565d600"}
Jul 02 19:52:32.847140 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.847102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54" event={"ID":"98cdd854-b9f3-45d6-899a-639e7abe774b","Type":"ContainerStarted","Data":"871e11286c962bbb6b3516c990b64e80e32e8ef9d37ef11d54d64880ac8799b1"}
Jul 02 19:52:32.866795 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.866715    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d9c874499-fcxts" podStartSLOduration=1.866634581 podStartE2EDuration="1.866634581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:32.864253491 +0000 UTC m=+97.159136004" watchObservedRunningTime="2026-07-02 19:52:32.866634581 +0000 UTC m=+97.161517098"
Jul 02 19:52:32.883667 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.882642    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:52:32.903431 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.903276    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.905386 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.905349    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:52:32.907853 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.907828    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 19:52:32.909330 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.909305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.909512    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.909675    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908107    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908151    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908239    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908520    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bsjdl\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908705    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908391    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4fhvkdcki5buu\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908831    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908204    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 19:52:32.910566 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.908433    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 19:52:32.911221 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.910587    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 19:52:32.911509 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.911486    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 19:52:32.960962 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.960910    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.960962 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.960967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbg7k\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-kube-api-access-hbg7k\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961398    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-config\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961484 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961576    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:32.961894 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:32.961664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062111 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062111 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062159    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062216    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.062991 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062961    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.063160 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.062995    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbg7k\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-kube-api-access-hbg7k\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.063160 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.063160 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063131    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.063160 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-config\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063227    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.064142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.063989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.065477 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.064602    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.065853 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.065814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.067930 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.067863    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.068974 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.068949    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.069546 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.069487    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.069546 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.069522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.069546 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.069527    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.069808 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.069767    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.069935 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.069913    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-config-out\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.070260 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.070216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-config\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.070345 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.070317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.070605 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.070580    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.070975 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.070956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.071406 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.071389    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-web-config\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.077746 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.077714    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbg7k\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-kube-api-access-hbg7k\") pod \"prometheus-k8s-0\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:33.221942 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:33.221511    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:35.372129 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.372099    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:52:35.373166 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:52:35.373135    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda946413c_136a_44a2_a19d_de2b56ff295f.slice/crio-844752e402e4a986b3fade7213ff211786f09cd3e163c51544067e14f29027b2 WatchSource:0}: Error finding container 844752e402e4a986b3fade7213ff211786f09cd3e163c51544067e14f29027b2: Status 404 returned error can't find the container with id 844752e402e4a986b3fade7213ff211786f09cd3e163c51544067e14f29027b2
Jul 02 19:52:35.861033 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.860993    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42" event={"ID":"3c71d76c-36d4-4102-aaf7-f2c332986222","Type":"ContainerStarted","Data":"d644c10a8cf5609c78d8992fa9f65aa4ee5212b68251476d64a753c09f1d2678"}
Jul 02 19:52:35.864445 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.863316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54" event={"ID":"98cdd854-b9f3-45d6-899a-639e7abe774b","Type":"ContainerStarted","Data":"0f16afd2612542cbe78bf986786f9c4a4cfcd316ac332eb32ed371d53c019a79"}
Jul 02 19:52:35.864445 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.864206    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:35.869125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.869099    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54"
Jul 02 19:52:35.869357 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.869329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"}
Jul 02 19:52:35.869439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.869391    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"}
Jul 02 19:52:35.869439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.869421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"}
Jul 02 19:52:35.869549 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.869450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"}
Jul 02 19:52:35.869549 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.869486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"}
Jul 02 19:52:35.870911 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.870888    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5" exitCode=0
Jul 02 19:52:35.871009 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.870929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"}
Jul 02 19:52:35.871009 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.870971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"844752e402e4a986b3fade7213ff211786f09cd3e163c51544067e14f29027b2"}
Jul 02 19:52:35.879536 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.879494    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42" podStartSLOduration=1.489107328 podStartE2EDuration="4.879478311s" totalImagesPullingTime="3.390370983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:35.878240361 +0000 UTC m=+100.173122876" watchObservedRunningTime="2026-07-02 19:52:35.879478311 +0000 UTC m=+100.174360824"
Jul 02 19:52:35.919855 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:35.919756    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7rn54" podStartSLOduration=2.248643189 podStartE2EDuration="4.919740755s" totalImagesPullingTime="2.671097566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:35.918728355 +0000 UTC m=+100.213610871" watchObservedRunningTime="2026-07-02 19:52:35.919740755 +0000 UTC m=+100.214623268"
Jul 02 19:52:37.884733 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:37.884688    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerStarted","Data":"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"}
Jul 02 19:52:37.919079 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:37.918024    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.228708764 podStartE2EDuration="10.918005139s" totalImagesPullingTime="6.671906825s" totalInitContainerRuntime="17.38955ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:37.917092201 +0000 UTC m=+102.211974714" watchObservedRunningTime="2026-07-02 19:52:37.918005139 +0000 UTC m=+102.212887653"
Jul 02 19:52:40.901110 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:40.901072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"}
Jul 02 19:52:40.901573 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:40.901156    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"}
Jul 02 19:52:42.066846 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:42.066800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:42.067366 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:42.066898    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:42.072275 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:42.072243    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:42.918864 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:42.916381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"}
Jul 02 19:52:42.922510 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:42.922486    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:52:43.716044 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:43.716012    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d4khc"
Jul 02 19:52:43.927352 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:43.927316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"}
Jul 02 19:52:43.927519 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:43.927405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"}
Jul 02 19:52:43.927519 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:43.927432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerStarted","Data":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"}
Jul 02 19:52:43.958542 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:43.958487    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.357906192 podStartE2EDuration="11.95846821s" totalImagesPullingTime="6.576182572s" totalInitContainerRuntime="24.379446ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:52:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:52:43.957339734 +0000 UTC m=+108.252222347" watchObservedRunningTime="2026-07-02 19:52:43.95846821 +0000 UTC m=+108.253350734"
Jul 02 19:52:48.222470 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:48.222431    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:52:51.451519 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:51.451480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:51.452066 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:51.451807    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:52:52.518267 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.518217    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6995fd47c4-l5g8t" podUID="acec302a-3e69-4b22-b463-469276b589f7" containerName="console" containerID="cri-o://3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3" gracePeriod=15
Jul 02 19:52:52.789976 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.789895    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:52.849739 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.849703    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-console-config\") pod \"acec302a-3e69-4b22-b463-469276b589f7\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") "
Jul 02 19:52:52.849950 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.849773    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-oauth-config\") pod \"acec302a-3e69-4b22-b463-469276b589f7\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") "
Jul 02 19:52:52.849950 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.849819    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spfbx\" (UniqueName: \"kubernetes.io/projected/acec302a-3e69-4b22-b463-469276b589f7-kube-api-access-spfbx\") pod \"acec302a-3e69-4b22-b463-469276b589f7\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") "
Jul 02 19:52:52.849950 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.849890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-oauth-serving-cert\") pod \"acec302a-3e69-4b22-b463-469276b589f7\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") "
Jul 02 19:52:52.849950 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.849934    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-serving-cert\") pod \"acec302a-3e69-4b22-b463-469276b589f7\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") "
Jul 02 19:52:52.850156 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.849967    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-service-ca\") pod \"acec302a-3e69-4b22-b463-469276b589f7\" (UID: \"acec302a-3e69-4b22-b463-469276b589f7\") "
Jul 02 19:52:52.850206 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.850185    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-console-config" (OuterVolumeSpecName: "console-config") pod "acec302a-3e69-4b22-b463-469276b589f7" (UID: "acec302a-3e69-4b22-b463-469276b589f7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:52:52.850335 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.850309    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "acec302a-3e69-4b22-b463-469276b589f7" (UID: "acec302a-3e69-4b22-b463-469276b589f7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:52:52.850449 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.850424    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-service-ca" (OuterVolumeSpecName: "service-ca") pod "acec302a-3e69-4b22-b463-469276b589f7" (UID: "acec302a-3e69-4b22-b463-469276b589f7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:52:52.852252 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.852223    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "acec302a-3e69-4b22-b463-469276b589f7" (UID: "acec302a-3e69-4b22-b463-469276b589f7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:52:52.852396 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.852355    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "acec302a-3e69-4b22-b463-469276b589f7" (UID: "acec302a-3e69-4b22-b463-469276b589f7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:52:52.852396 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.852359    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acec302a-3e69-4b22-b463-469276b589f7-kube-api-access-spfbx" (OuterVolumeSpecName: "kube-api-access-spfbx") pod "acec302a-3e69-4b22-b463-469276b589f7" (UID: "acec302a-3e69-4b22-b463-469276b589f7"). InnerVolumeSpecName "kube-api-access-spfbx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:52:52.950855 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.950816    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:52.950855 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.950848    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-service-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:52.950855 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.950857    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-console-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:52.950855 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.950865    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/acec302a-3e69-4b22-b463-469276b589f7-console-oauth-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:52.951180 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.950900    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spfbx\" (UniqueName: \"kubernetes.io/projected/acec302a-3e69-4b22-b463-469276b589f7-kube-api-access-spfbx\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:52.951180 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.950910    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/acec302a-3e69-4b22-b463-469276b589f7-oauth-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:52:52.967798 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.967759    2562 generic.go:356] "Generic (PLEG): container finished" podID="acec302a-3e69-4b22-b463-469276b589f7" containerID="3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3" exitCode=0
Jul 02 19:52:52.967985 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.967811    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6995fd47c4-l5g8t"
Jul 02 19:52:52.967985 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.967846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995fd47c4-l5g8t" event={"ID":"acec302a-3e69-4b22-b463-469276b589f7","Type":"ContainerDied","Data":"3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3"}
Jul 02 19:52:52.967985 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.967923    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6995fd47c4-l5g8t" event={"ID":"acec302a-3e69-4b22-b463-469276b589f7","Type":"ContainerDied","Data":"6f4b32653766ca9df445ee5812771efcc2c14fecc40d289874facefd356b7f0d"}
Jul 02 19:52:52.981182 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.981151    2562 scope.go:117] "RemoveContainer" containerID="3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3"
Jul 02 19:52:52.989783 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.989766    2562 scope.go:117] "RemoveContainer" containerID="3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3"
Jul 02 19:52:52.989899 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.989863    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6995fd47c4-l5g8t"]
Jul 02 19:52:52.990090 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:52:52.990071    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3\": container with ID starting with 3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3 not found: ID does not exist" containerID="3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3"
Jul 02 19:52:52.990153 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.990106    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3"} err="failed to get container status \"3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3\": rpc error: code = NotFound desc = could not find container \"3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3\": container with ID starting with 3f244bdf3a76e913791b7335c419841cdffc4cfec26a6b09703764727243f9b3 not found: ID does not exist"
Jul 02 19:52:52.993361 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:52.993339    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6995fd47c4-l5g8t"]
Jul 02 19:52:54.263475 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:52:54.263439    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acec302a-3e69-4b22-b463-469276b589f7" path="/var/lib/kubelet/pods/acec302a-3e69-4b22-b463-469276b589f7/volumes"
Jul 02 19:53:11.456915 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:11.456858    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:53:11.461019 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:11.460987    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8665f9f9d8-ptf42"
Jul 02 19:53:33.222395 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:33.222359    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:33.242008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:33.241979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:34.155084 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:34.155058    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:46.909691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.909653    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:53:46.910216 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.909945    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="alertmanager" containerID="cri-o://7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237" gracePeriod=120
Jul 02 19:53:46.910216 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.910028    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-web" containerID="cri-o://0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b" gracePeriod=120
Jul 02 19:53:46.910216 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.910055    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="config-reloader" containerID="cri-o://2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52" gracePeriod=120
Jul 02 19:53:46.910216 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.910075    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy" containerID="cri-o://8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db" gracePeriod=120
Jul 02 19:53:46.910216 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.910029    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-metric" containerID="cri-o://bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc" gracePeriod=120
Jul 02 19:53:46.910216 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:46.910079    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="prom-label-proxy" containerID="cri-o://79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae" gracePeriod=120
Jul 02 19:53:47.197862 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197772    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae" exitCode=0
Jul 02 19:53:47.197862 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197795    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db" exitCode=0
Jul 02 19:53:47.197862 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197802    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52" exitCode=0
Jul 02 19:53:47.197862 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197807    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237" exitCode=0
Jul 02 19:53:47.197862 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197849    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"}
Jul 02 19:53:47.198201 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"}
Jul 02 19:53:47.198201 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.197975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"}
Jul 02 19:53:47.198201 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:47.198001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"}
Jul 02 19:53:48.157391 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.157369    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.212667 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212583    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc" exitCode=0
Jul 02 19:53:48.212667 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212615    2562 generic.go:356] "Generic (PLEG): container finished" podID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerID="0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b" exitCode=0
Jul 02 19:53:48.212667 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"}
Jul 02 19:53:48.212929 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212685    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.212929 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"}
Jul 02 19:53:48.212929 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0b228489-9f01-4c5c-89b7-1c025c69041a","Type":"ContainerDied","Data":"3b655fada0221111ddf67c2a02087ca54394336a0deab768226f993b6a6818b9"}
Jul 02 19:53:48.212929 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.212817    2562 scope.go:117] "RemoveContainer" containerID="79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"
Jul 02 19:53:48.220574 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.220541    2562 scope.go:117] "RemoveContainer" containerID="bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"
Jul 02 19:53:48.228778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.228760    2562 scope.go:117] "RemoveContainer" containerID="8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"
Jul 02 19:53:48.235833 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.235803    2562 scope.go:117] "RemoveContainer" containerID="0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"
Jul 02 19:53:48.243071 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.243047    2562 scope.go:117] "RemoveContainer" containerID="2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"
Jul 02 19:53:48.250859 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.250834    2562 scope.go:117] "RemoveContainer" containerID="7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"
Jul 02 19:53:48.256168 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256143    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256281 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256185    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-web-config\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256281 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256229    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256281 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256267    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-config-out\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256297    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-metrics-client-ca\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256361    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-main-db\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-tls-assets\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256428    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-cluster-tls-config\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256475    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-web\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256504    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-config-volume\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256530    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfkz4\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-kube-api-access-sfkz4\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.256691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.256587    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-trusted-ca-bundle\") pod \"0b228489-9f01-4c5c-89b7-1c025c69041a\" (UID: \"0b228489-9f01-4c5c-89b7-1c025c69041a\") "
Jul 02 19:53:48.257210 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.257180    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:48.257423 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.257397    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:48.257597 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.257570    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:48.260179 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.260153    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.261144 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.260907    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.261144 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.261117    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.261424 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.261331    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:53:48.261424 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.261406    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.261559 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.261541    2562 scope.go:117] "RemoveContainer" containerID="3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"
Jul 02 19:53:48.262524 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.262483    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-config-out" (OuterVolumeSpecName: "config-out") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:48.262809 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.262787    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-config-volume" (OuterVolumeSpecName: "config-volume") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.263204 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.263007    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-kube-api-access-sfkz4" (OuterVolumeSpecName: "kube-api-access-sfkz4") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "kube-api-access-sfkz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:53:48.265583 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.265543    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.274450 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.274420    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-web-config" (OuterVolumeSpecName: "web-config") pod "0b228489-9f01-4c5c-89b7-1c025c69041a" (UID: "0b228489-9f01-4c5c-89b7-1c025c69041a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:48.276817 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.276800    2562 scope.go:117] "RemoveContainer" containerID="79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"
Jul 02 19:53:48.277183 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.277161    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae\": container with ID starting with 79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae not found: ID does not exist" containerID="79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"
Jul 02 19:53:48.277238 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277193    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"} err="failed to get container status \"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae\": rpc error: code = NotFound desc = could not find container \"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae\": container with ID starting with 79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae not found: ID does not exist"
Jul 02 19:53:48.277238 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277212    2562 scope.go:117] "RemoveContainer" containerID="bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"
Jul 02 19:53:48.277442 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.277421    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc\": container with ID starting with bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc not found: ID does not exist" containerID="bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"
Jul 02 19:53:48.277485 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277449    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"} err="failed to get container status \"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc\": rpc error: code = NotFound desc = could not find container \"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc\": container with ID starting with bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc not found: ID does not exist"
Jul 02 19:53:48.277485 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277464    2562 scope.go:117] "RemoveContainer" containerID="8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"
Jul 02 19:53:48.277706 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.277691    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db\": container with ID starting with 8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db not found: ID does not exist" containerID="8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"
Jul 02 19:53:48.277765 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277708    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"} err="failed to get container status \"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db\": rpc error: code = NotFound desc = could not find container \"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db\": container with ID starting with 8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db not found: ID does not exist"
Jul 02 19:53:48.277765 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277719    2562 scope.go:117] "RemoveContainer" containerID="0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"
Jul 02 19:53:48.277975 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.277958    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b\": container with ID starting with 0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b not found: ID does not exist" containerID="0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"
Jul 02 19:53:48.278021 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277979    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"} err="failed to get container status \"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b\": rpc error: code = NotFound desc = could not find container \"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b\": container with ID starting with 0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b not found: ID does not exist"
Jul 02 19:53:48.278021 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.277992    2562 scope.go:117] "RemoveContainer" containerID="2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"
Jul 02 19:53:48.278239 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.278222    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52\": container with ID starting with 2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52 not found: ID does not exist" containerID="2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"
Jul 02 19:53:48.278279 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.278246    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"} err="failed to get container status \"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52\": rpc error: code = NotFound desc = could not find container \"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52\": container with ID starting with 2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52 not found: ID does not exist"
Jul 02 19:53:48.278279 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.278262    2562 scope.go:117] "RemoveContainer" containerID="7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"
Jul 02 19:53:48.278489 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.278474    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237\": container with ID starting with 7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237 not found: ID does not exist" containerID="7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"
Jul 02 19:53:48.278532 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.278493    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"} err="failed to get container status \"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237\": rpc error: code = NotFound desc = could not find container \"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237\": container with ID starting with 7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237 not found: ID does not exist"
Jul 02 19:53:48.278532 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.278506    2562 scope.go:117] "RemoveContainer" containerID="3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"
Jul 02 19:53:48.278730 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:48.278712    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051\": container with ID starting with 3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051 not found: ID does not exist" containerID="3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"
Jul 02 19:53:48.278789 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.278737    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"} err="failed to get container status \"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051\": rpc error: code = NotFound desc = could not find container \"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051\": container with ID starting with 3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051 not found: ID does not exist"
Jul 02 19:53:48.278789 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.278758    2562 scope.go:117] "RemoveContainer" containerID="79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"
Jul 02 19:53:48.279024 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279008    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae"} err="failed to get container status \"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae\": rpc error: code = NotFound desc = could not find container \"79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae\": container with ID starting with 79e634f9e8b764707618ca36f0c35d7020803ee59f6d59574f27e7098ac660ae not found: ID does not exist"
Jul 02 19:53:48.279080 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279024    2562 scope.go:117] "RemoveContainer" containerID="bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"
Jul 02 19:53:48.279232 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279216    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc"} err="failed to get container status \"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc\": rpc error: code = NotFound desc = could not find container \"bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc\": container with ID starting with bcd4c6c29c8ffcb0f9e8f2f37a3bb0723e2cfef22097a3515210a9f64568eedc not found: ID does not exist"
Jul 02 19:53:48.279276 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279233    2562 scope.go:117] "RemoveContainer" containerID="8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"
Jul 02 19:53:48.279424 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279406    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db"} err="failed to get container status \"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db\": rpc error: code = NotFound desc = could not find container \"8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db\": container with ID starting with 8bbb31160069a0e25b8887a7db1c7501523bee7871a1317f3032188d359845db not found: ID does not exist"
Jul 02 19:53:48.279488 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279426    2562 scope.go:117] "RemoveContainer" containerID="0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"
Jul 02 19:53:48.279642 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b"} err="failed to get container status \"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b\": rpc error: code = NotFound desc = could not find container \"0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b\": container with ID starting with 0b79b908d44ceea2df5bfa096ded990eaa032c34edbe691e8f1f81bd63165f6b not found: ID does not exist"
Jul 02 19:53:48.279687 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279642    2562 scope.go:117] "RemoveContainer" containerID="2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"
Jul 02 19:53:48.279837 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279818    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52"} err="failed to get container status \"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52\": rpc error: code = NotFound desc = could not find container \"2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52\": container with ID starting with 2053dc1c970d481ef177d633ee1cae1455b3ebe65461d958b05fcdca79dcbd52 not found: ID does not exist"
Jul 02 19:53:48.279931 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.279838    2562 scope.go:117] "RemoveContainer" containerID="7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"
Jul 02 19:53:48.280061 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.280044    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237"} err="failed to get container status \"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237\": rpc error: code = NotFound desc = could not find container \"7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237\": container with ID starting with 7996c9e26b0553e73bd6e90dc3fbee715240e49044c7a2bfffaa92a3cb33f237 not found: ID does not exist"
Jul 02 19:53:48.280106 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.280061    2562 scope.go:117] "RemoveContainer" containerID="3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"
Jul 02 19:53:48.280248 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.280232    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051"} err="failed to get container status \"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051\": rpc error: code = NotFound desc = could not find container \"3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051\": container with ID starting with 3b9c40fb547e2248a8159d16fe8f2ac8de328d212a9ea885f19dd9d40dcb9051 not found: ID does not exist"
Jul 02 19:53:48.357817 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357773    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.357817 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357807    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-config-out\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.357817 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357820    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-metrics-client-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.357817 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357829    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357841    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-main-db\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357854    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-tls-assets\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357865    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-cluster-tls-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357888    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357901    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-config-volume\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357914    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfkz4\" (UniqueName: \"kubernetes.io/projected/0b228489-9f01-4c5c-89b7-1c025c69041a-kube-api-access-sfkz4\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357922    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b228489-9f01-4c5c-89b7-1c025c69041a-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357931    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-secret-alertmanager-main-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.358148 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.357940    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0b228489-9f01-4c5c-89b7-1c025c69041a-web-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:48.537567 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.537530    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:53:48.541626 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.541591    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:53:48.571720 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.571674    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:53:48.572100 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572081    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-metric"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572103    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-metric"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572119    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572127    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572135    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="init-config-reloader"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572145    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="init-config-reloader"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572162    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-web"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572171    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-web"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572189    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acec302a-3e69-4b22-b463-469276b589f7" containerName="console"
Jul 02 19:53:48.572196 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572198    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="acec302a-3e69-4b22-b463-469276b589f7" containerName="console"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572208    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="config-reloader"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572216    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="config-reloader"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572231    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="alertmanager"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572240    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="alertmanager"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572249    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="prom-label-proxy"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572257    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="prom-label-proxy"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572340    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="alertmanager"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572355    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="prom-label-proxy"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572367    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="acec302a-3e69-4b22-b463-469276b589f7" containerName="console"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572379    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572389    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="config-reloader"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572398    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-web"
Jul 02 19:53:48.572661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.572409    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" containerName="kube-rbac-proxy-metric"
Jul 02 19:53:48.576601 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.576571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.579093 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 02 19:53:48.579239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579066    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 02 19:53:48.579239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 02 19:53:48.579386 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579370    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 02 19:53:48.579458 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 02 19:53:48.579612 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579595    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 02 19:53:48.579612 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579618    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-prp4p\""
Jul 02 19:53:48.579807 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 02 19:53:48.579807 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.579667    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 02 19:53:48.584687 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.584664    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 02 19:53:48.591221 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.591194    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:53:48.659686 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659686 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63efd5bd-5e2b-4f41-b283-bc3da064db0a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659945 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63efd5bd-5e2b-4f41-b283-bc3da064db0a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659945 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63efd5bd-5e2b-4f41-b283-bc3da064db0a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659945 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63efd5bd-5e2b-4f41-b283-bc3da064db0a-config-out\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659945 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659945 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659909    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63efd5bd-5e2b-4f41-b283-bc3da064db0a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.659945 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-config-volume\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.660240 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.659956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.660240 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.660023    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-web-config\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.660240 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.660130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2jkf\" (UniqueName: \"kubernetes.io/projected/63efd5bd-5e2b-4f41-b283-bc3da064db0a-kube-api-access-t2jkf\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.660240 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.660161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.660240 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.660192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761048 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761008    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2jkf\" (UniqueName: \"kubernetes.io/projected/63efd5bd-5e2b-4f41-b283-bc3da064db0a-kube-api-access-t2jkf\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761048 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63efd5bd-5e2b-4f41-b283-bc3da064db0a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63efd5bd-5e2b-4f41-b283-bc3da064db0a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63efd5bd-5e2b-4f41-b283-bc3da064db0a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63efd5bd-5e2b-4f41-b283-bc3da064db0a-config-out\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63efd5bd-5e2b-4f41-b283-bc3da064db0a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761308 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-config-volume\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761773 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761324    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.761773 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-web-config\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.762022 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.761998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63efd5bd-5e2b-4f41-b283-bc3da064db0a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.762704 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.762678    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63efd5bd-5e2b-4f41-b283-bc3da064db0a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.763521 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.763496    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63efd5bd-5e2b-4f41-b283-bc3da064db0a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764534 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764383    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764534 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764486    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764690 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764690 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764601    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63efd5bd-5e2b-4f41-b283-bc3da064db0a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764690 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764637    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764807 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764697    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-config-volume\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.764807 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.764764    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-web-config\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.765815 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.765799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63efd5bd-5e2b-4f41-b283-bc3da064db0a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.766173 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.766157    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63efd5bd-5e2b-4f41-b283-bc3da064db0a-config-out\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.768985 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.768959    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2jkf\" (UniqueName: \"kubernetes.io/projected/63efd5bd-5e2b-4f41-b283-bc3da064db0a-kube-api-access-t2jkf\") pod \"alertmanager-main-0\" (UID: \"63efd5bd-5e2b-4f41-b283-bc3da064db0a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:48.887036 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:48.886934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 02 19:53:49.028662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:49.028635    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 02 19:53:49.031083 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:53:49.031049    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63efd5bd_5e2b_4f41_b283_bc3da064db0a.slice/crio-6ab0837117d6a47a13b9d31d9b4d23b6fadab6cd63b31eee9015699a9d9ac615 WatchSource:0}: Error finding container 6ab0837117d6a47a13b9d31d9b4d23b6fadab6cd63b31eee9015699a9d9ac615: Status 404 returned error can't find the container with id 6ab0837117d6a47a13b9d31d9b4d23b6fadab6cd63b31eee9015699a9d9ac615
Jul 02 19:53:49.220225 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:49.220129    2562 generic.go:356] "Generic (PLEG): container finished" podID="63efd5bd-5e2b-4f41-b283-bc3da064db0a" containerID="8f7f406a55a270ab74fa768867035581758097ad00c61591e91ef608e40ec352" exitCode=0
Jul 02 19:53:49.220578 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:49.220214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerDied","Data":"8f7f406a55a270ab74fa768867035581758097ad00c61591e91ef608e40ec352"}
Jul 02 19:53:49.220578 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:49.220291    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"6ab0837117d6a47a13b9d31d9b4d23b6fadab6cd63b31eee9015699a9d9ac615"}
Jul 02 19:53:50.227438 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.227392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"0a1635fbe490566e467fd6139ea5f84062941c0334a53e8c338c31d5f37ae671"}
Jul 02 19:53:50.227788 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.227496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"7ef080294412d67e3272249894ecd4406b8f0452bba3075890a2d72a480157aa"}
Jul 02 19:53:50.227788 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.227522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"a02afc1d9ba9a833cb83a8612761de6bd7c7eda919854c8d216f5c03db57c13a"}
Jul 02 19:53:50.227788 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.227548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"dcc67deb70dc410d8cb6967bedc6aca4ee37ffb116ecb3099b8dd121725d635c"}
Jul 02 19:53:50.227788 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.227571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"9d20316c79b47c7a6036bbeaa7b590c0086191ef4826440967a7dee3fec58c62"}
Jul 02 19:53:50.227788 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.227594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63efd5bd-5e2b-4f41-b283-bc3da064db0a","Type":"ContainerStarted","Data":"5a5bfde1eb30ec9366b2b060b2a8515e69b6ea1b527661bd23aee3ebb15b459b"}
Jul 02 19:53:50.255829 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.255768    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.240479788 podStartE2EDuration="2.255746585s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.266797ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:50.253852947 +0000 UTC m=+174.548735461" watchObservedRunningTime="2026-07-02 19:53:50.255746585 +0000 UTC m=+174.550629129"
Jul 02 19:53:50.268933 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:50.268899    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b228489-9f01-4c5c-89b7-1c025c69041a" path="/var/lib/kubelet/pods/0b228489-9f01-4c5c-89b7-1c025c69041a/volumes"
Jul 02 19:53:51.173705 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.173661    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:53:51.174137 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.173972    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="prometheus" containerID="cri-o://bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae" gracePeriod=600
Jul 02 19:53:51.174137 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.173998    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db" gracePeriod=600
Jul 02 19:53:51.174137 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.174022    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="thanos-sidecar" containerID="cri-o://2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534" gracePeriod=600
Jul 02 19:53:51.174137 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.174021    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy" containerID="cri-o://90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2" gracePeriod=600
Jul 02 19:53:51.174137 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.174058    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="config-reloader" containerID="cri-o://e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a" gracePeriod=600
Jul 02 19:53:51.174137 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.173994    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-web" containerID="cri-o://9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c" gracePeriod=600
Jul 02 19:53:51.433225 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.433152    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:51.593818 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.593783    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-0\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.593839    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-metrics-client-certs\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.593896    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-web-config\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.593927    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-kubelet-serving-ca-bundle\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.593949    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-grpc-tls\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.593980    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594030 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-config\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594033    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-config-out\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594061    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-db\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594093    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-metrics-client-ca\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594119    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-tls\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594149    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-kube-rbac-proxy\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594182    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-trusted-ca-bundle\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-thanos-prometheus-http-client-file\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594254    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbg7k\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-kube-api-access-hbg7k\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594247    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594296    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594322    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-2\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-1\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-tls-assets\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594430    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-serving-certs-ca-bundle\") pod \"a946413c-136a-44a2-a19d-de2b56ff295f\" (UID: \"a946413c-136a-44a2-a19d-de2b56ff295f\") "
Jul 02 19:53:51.594814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594545    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.594814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594736    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.594814 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.594754    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-metrics-client-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.595436 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.595404    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.596128 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.596103    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.596584 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.596551    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.596934 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.596909    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.597125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597082    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.597200 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597159    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.597405 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597374    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:53:51.597552 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597530    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:51.597623 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597585    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-config" (OuterVolumeSpecName: "config") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.597846 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597810    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.597846 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597834    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.598004 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.597916    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.598689 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.598651    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:53:51.599045 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.599013    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-config-out" (OuterVolumeSpecName: "config-out") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 19:53:51.599150 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.599087    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.599703 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.599683    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.599935 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.599911    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-kube-api-access-hbg7k" (OuterVolumeSpecName: "kube-api-access-hbg7k") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "kube-api-access-hbg7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:53:51.608310 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.608286    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-web-config" (OuterVolumeSpecName: "web-config") pod "a946413c-136a-44a2-a19d-de2b56ff295f" (UID: "a946413c-136a-44a2-a19d-de2b56ff295f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695768    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-metrics-client-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695799    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-web-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695810    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-grpc-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695821    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695830    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695838    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-config-out\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695847    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-db\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695855    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.695858 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695864    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-kube-rbac-proxy\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695894    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695904    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695912    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbg7k\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-kube-api-access-hbg7k\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695921    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a946413c-136a-44a2-a19d-de2b56ff295f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695929    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695937    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695945    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a946413c-136a-44a2-a19d-de2b56ff295f-tls-assets\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695953    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:51.696239 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:51.695962    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a946413c-136a-44a2-a19d-de2b56ff295f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:53:52.239207 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239174    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db" exitCode=0
Jul 02 19:53:52.239207 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239200    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2" exitCode=0
Jul 02 19:53:52.239207 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239208    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c" exitCode=0
Jul 02 19:53:52.239207 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239216    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534" exitCode=0
Jul 02 19:53:52.239207 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239222    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a" exitCode=0
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239229    2562 generic.go:356] "Generic (PLEG): container finished" podID="a946413c-136a-44a2-a19d-de2b56ff295f" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae" exitCode=0
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"}
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239271    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"}
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"}
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"}
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"}
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"}
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239403    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.239666 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.239516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a946413c-136a-44a2-a19d-de2b56ff295f","Type":"ContainerDied","Data":"844752e402e4a986b3fade7213ff211786f09cd3e163c51544067e14f29027b2"}
Jul 02 19:53:52.247389 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.247356    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.254985 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.254965    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.263121 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.262434    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.266362 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.266329    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:53:52.271691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.271661    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:53:52.275800 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.275779    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.282932 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.282907    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.289955 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.289933    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.295203 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295183    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:53:52.295466 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295455    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="prometheus"
Jul 02 19:53:52.295506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295468    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="prometheus"
Jul 02 19:53:52.295506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295487    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="thanos-sidecar"
Jul 02 19:53:52.295506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295493    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="thanos-sidecar"
Jul 02 19:53:52.295506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295501    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="init-config-reloader"
Jul 02 19:53:52.295506 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295506    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="init-config-reloader"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295512    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295517    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295527    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-thanos"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295531    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-thanos"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295540    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="config-reloader"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295545    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="config-reloader"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295551    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-web"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295556    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-web"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295599    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="prometheus"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295607    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-thanos"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295615    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="thanos-sidecar"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295622    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="config-reloader"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295627    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy"
Jul 02 19:53:52.295662 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.295632    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" containerName="kube-rbac-proxy-web"
Jul 02 19:53:52.297440 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.297422    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.297726 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.297704    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.297778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.297736    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"} err="failed to get container status \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist"
Jul 02 19:53:52.297778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.297761    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.298023 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.298004    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.298098 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298033    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"} err="failed to get container status \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist"
Jul 02 19:53:52.298098 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298054    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.298316 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.298293    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.298378 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298324    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"} err="failed to get container status \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist"
Jul 02 19:53:52.298378 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298339    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.298577 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.298559    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.298638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298587    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"} err="failed to get container status \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist"
Jul 02 19:53:52.298638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298610    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.298907 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.298860    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.299008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298917    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"} err="failed to get container status \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist"
Jul 02 19:53:52.299008 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.298933    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.299208 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.299179    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.299272 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.299207    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"} err="failed to get container status \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist"
Jul 02 19:53:52.299272 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.299226    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.299527 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.299286    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.299527 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:53:52.299480    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.299527 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.299509    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"} err="failed to get container status \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist"
Jul 02 19:53:52.299527 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.299527    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.300000 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.299972    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"} err="failed to get container status \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist"
Jul 02 19:53:52.300128 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300002    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.300260 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300240    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"} err="failed to get container status \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist"
Jul 02 19:53:52.300325 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300262    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.300533 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300512    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"} err="failed to get container status \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist"
Jul 02 19:53:52.300596 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300536    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.300791 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300771    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"} err="failed to get container status \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist"
Jul 02 19:53:52.300791 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.300790    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.301043 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301022    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"} err="failed to get container status \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist"
Jul 02 19:53:52.301095 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301045    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.301290 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301272    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"} err="failed to get container status \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist"
Jul 02 19:53:52.301340 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301291    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.301513 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301494    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"} err="failed to get container status \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist"
Jul 02 19:53:52.301561 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301516    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.301726 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301714    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 02 19:53:52.301785 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301765    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"} err="failed to get container status \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist"
Jul 02 19:53:52.301824 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.301787    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.302043 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302024    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 02 19:53:52.302125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302023    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"} err="failed to get container status \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist"
Jul 02 19:53:52.302125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302061    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.302125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302076    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 02 19:53:52.302125 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302078    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 02 19:53:52.302328 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302132    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 02 19:53:52.302328 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 02 19:53:52.302328 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302295    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"} err="failed to get container status \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist"
Jul 02 19:53:52.302328 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302320    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.302525 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302373    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-4fhvkdcki5buu\""
Jul 02 19:53:52.302578 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302559    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"} err="failed to get container status \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist"
Jul 02 19:53:52.302615 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302579    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.302661 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302616    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 02 19:53:52.302737 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 02 19:53:52.302791 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302757    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 02 19:53:52.303015 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.302992    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"} err="failed to get container status \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist"
Jul 02 19:53:52.303085 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303017    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.303199 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303176    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 02 19:53:52.303358 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303335    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"} err="failed to get container status \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist"
Jul 02 19:53:52.303439 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303359    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.303490 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303481    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 02 19:53:52.303654 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303628    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"} err="failed to get container status \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist"
Jul 02 19:53:52.303743 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303656    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.303898 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303862    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"} err="failed to get container status \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist"
Jul 02 19:53:52.303973 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.303898    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.304168 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304140    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 02 19:53:52.304168 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304144    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"} err="failed to get container status \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist"
Jul 02 19:53:52.304295 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304173    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.304434 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304407    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"} err="failed to get container status \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist"
Jul 02 19:53:52.304434 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304434    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.304702 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304673    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"} err="failed to get container status \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist"
Jul 02 19:53:52.304897 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304703    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.304993 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.304975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bsjdl\""
Jul 02 19:53:52.305115 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.305070    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"} err="failed to get container status \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist"
Jul 02 19:53:52.305200 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.305184    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.305490 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.305461    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"} err="failed to get container status \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist"
Jul 02 19:53:52.305585 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.305491    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.305770 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.305752    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"} err="failed to get container status \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist"
Jul 02 19:53:52.305847 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.305777    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.306048 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306027    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 02 19:53:52.306139 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306084    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"} err="failed to get container status \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist"
Jul 02 19:53:52.306139 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306109    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.306399 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306376    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"} err="failed to get container status \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist"
Jul 02 19:53:52.306458 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306402    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.306703 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306665    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"} err="failed to get container status \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist"
Jul 02 19:53:52.306703 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.306691    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.307116 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307093    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"} err="failed to get container status \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist"
Jul 02 19:53:52.307221 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307119    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.307379 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307361    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"} err="failed to get container status \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist"
Jul 02 19:53:52.307450 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307382    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.307618 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307602    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"} err="failed to get container status \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist"
Jul 02 19:53:52.307683 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307618    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.307849 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307816    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"} err="failed to get container status \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist"
Jul 02 19:53:52.307849 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.307836    2562 scope.go:117] "RemoveContainer" containerID="d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"
Jul 02 19:53:52.308218 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308154    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db"} err="failed to get container status \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": rpc error: code = NotFound desc = could not find container \"d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db\": container with ID starting with d9eaf4c4265504d49b1b9ccc597dc67ebe95113dcda86eb7a14af4878293b1db not found: ID does not exist"
Jul 02 19:53:52.308218 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308176    2562 scope.go:117] "RemoveContainer" containerID="90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"
Jul 02 19:53:52.308491 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308472    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2"} err="failed to get container status \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": rpc error: code = NotFound desc = could not find container \"90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2\": container with ID starting with 90956fc08d3174c44256c92ad89666118002d6290fd4f0b24131f09c6fc43db2 not found: ID does not exist"
Jul 02 19:53:52.308597 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308492    2562 scope.go:117] "RemoveContainer" containerID="9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"
Jul 02 19:53:52.308723 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308699    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c"} err="failed to get container status \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": rpc error: code = NotFound desc = could not find container \"9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c\": container with ID starting with 9744ecf3bd7d46b649524de6197dfb2ab8ba2aa146f5e39563f324e6e69a1d0c not found: ID does not exist"
Jul 02 19:53:52.308723 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308726    2562 scope.go:117] "RemoveContainer" containerID="2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"
Jul 02 19:53:52.308991 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308972    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534"} err="failed to get container status \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": rpc error: code = NotFound desc = could not find container \"2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534\": container with ID starting with 2880fde115c3dac1717ae05dae26b738ba9bb6638ac58a4a7254c5a7fadc8534 not found: ID does not exist"
Jul 02 19:53:52.309103 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.308991    2562 scope.go:117] "RemoveContainer" containerID="e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"
Jul 02 19:53:52.309213 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.309193    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a"} err="failed to get container status \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": rpc error: code = NotFound desc = could not find container \"e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a\": container with ID starting with e05714db191e89bcb3c15f2e52914e7c4a2f9df1c57062fde961af093961cb9a not found: ID does not exist"
Jul 02 19:53:52.309272 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.309214    2562 scope.go:117] "RemoveContainer" containerID="bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"
Jul 02 19:53:52.309477 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.309457    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae"} err="failed to get container status \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": rpc error: code = NotFound desc = could not find container \"bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae\": container with ID starting with bd4ca572ea1aa6e908c3dbd1d0f6dcb5cc18b0d247eeeb4e70a564f74e6955ae not found: ID does not exist"
Jul 02 19:53:52.309477 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.309476    2562 scope.go:117] "RemoveContainer" containerID="4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"
Jul 02 19:53:52.309706 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.309606    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 02 19:53:52.309788 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.309705    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5"} err="failed to get container status \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": rpc error: code = NotFound desc = could not find container \"4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5\": container with ID starting with 4171ec968f43e1c179c5d98a2a8f9a70ddff910b1d2250efd1ed38d00c11a1f5 not found: ID does not exist"
Jul 02 19:53:52.316206 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.316183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:53:52.401710 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.401902 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.401902 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.401902 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.401902 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-config\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.401902 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401929    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.401995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402077    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27x5r\" (UniqueName: \"kubernetes.io/projected/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-kube-api-access-27x5r\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402412 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402412 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402191    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402412 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402412 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402261    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402412 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.402412 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.402301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503076 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503166    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503238    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-config\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27x5r\" (UniqueName: \"kubernetes.io/projected/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-kube-api-access-27x5r\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.503619 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.504590 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.504590 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.503621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.504590 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.504080    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.504590 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.504133    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.505960 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.505534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.505960 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.505842    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.505960 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.505951    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.506217 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.506147    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.506647 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.506593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.507768 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.507214    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.507768 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.507438    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-web-config\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.507768 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.507713    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.507768 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.507744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.508055 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.507846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-config\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.508387 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.508364    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-config-out\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.508622 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.508601    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.509100 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.509072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.509229 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.509210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.509339 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.509311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.509646 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.509625    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.509710 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.509688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.513267 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.513250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27x5r\" (UniqueName: \"kubernetes.io/projected/0d6b1fed-2304-4739-a744-d4cda2a5eb0d-kube-api-access-27x5r\") pod \"prometheus-k8s-0\" (UID: \"0d6b1fed-2304-4739-a744-d4cda2a5eb0d\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.611554 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.611515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:53:52.764837 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:52.764808    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 02 19:53:52.767152 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:53:52.767121    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6b1fed_2304_4739_a744_d4cda2a5eb0d.slice/crio-b0b7a1041d628542673f51ac088ff87fee0aab5571004b2f93f82a1dcc22e264 WatchSource:0}: Error finding container b0b7a1041d628542673f51ac088ff87fee0aab5571004b2f93f82a1dcc22e264: Status 404 returned error can't find the container with id b0b7a1041d628542673f51ac088ff87fee0aab5571004b2f93f82a1dcc22e264
Jul 02 19:53:53.247869 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:53.247836    2562 generic.go:356] "Generic (PLEG): container finished" podID="0d6b1fed-2304-4739-a744-d4cda2a5eb0d" containerID="c03269cb44fcf8232e5245ea7c72eaacfeedfca6b0a2abf1144d6c60b1c6a510" exitCode=0
Jul 02 19:53:53.248068 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:53.247926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerDied","Data":"c03269cb44fcf8232e5245ea7c72eaacfeedfca6b0a2abf1144d6c60b1c6a510"}
Jul 02 19:53:53.248068 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:53.248003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"b0b7a1041d628542673f51ac088ff87fee0aab5571004b2f93f82a1dcc22e264"}
Jul 02 19:53:54.255371 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.255333    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"0c3f09419d5040b301aee4224b46f100acc9a4829389eeb8ef22dc2cbc03a65d"}
Jul 02 19:53:54.255771 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.255428    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"f3a6fd06003b74756d3f35410811afee1b4c56e574f02c67c056db1037101ecb"}
Jul 02 19:53:54.255771 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.255456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"6a6a68a431360f4e15da3328c2e742c470cd42b29ab5da75dc9862487e59241d"}
Jul 02 19:53:54.255771 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.255482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"a20e468df25a31c97cfe0cde4e90e9292c8e39a978239027dbc2cfc8f3329217"}
Jul 02 19:53:54.255771 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.255508    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"8860fbb11b6a93400c53b239531869a16807a3c05026a691a41477fe33b38e92"}
Jul 02 19:53:54.255771 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.255531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0d6b1fed-2304-4739-a744-d4cda2a5eb0d","Type":"ContainerStarted","Data":"a97e41dc6921b5a50e297ec7cb23c987e445b330d4f5b81f6909039a6b9757df"}
Jul 02 19:53:54.264995 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.264960    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a946413c-136a-44a2-a19d-de2b56ff295f" path="/var/lib/kubelet/pods/a946413c-136a-44a2-a19d-de2b56ff295f/volumes"
Jul 02 19:53:54.283480 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:54.283424    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.263622126 podStartE2EDuration="2.283406726s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.7846ms" isStatefulPod=false podCreationTimestamp="2026-07-02 19:53:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:53:54.281508277 +0000 UTC m=+178.576390827" watchObservedRunningTime="2026-07-02 19:53:54.283406726 +0000 UTC m=+178.578289270"
Jul 02 19:53:57.612296 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:53:57.612259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:54:06.895100 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:06.895064    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9c874499-fcxts"]
Jul 02 19:54:31.915408 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:31.915344    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d9c874499-fcxts" podUID="52af0cf8-7cb7-4473-9e0e-78a2608d2098" containerName="console" containerID="cri-o://32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192" gracePeriod=15
Jul 02 19:54:32.161765 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.161737    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:54:32.259500 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259467    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-serving-cert\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.259664 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259507    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-oauth-serving-cert\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.259664 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259554    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-trusted-ca-bundle\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.259664 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259577    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-oauth-config\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.259664 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259622    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-service-ca\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.259864 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259668    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-config\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.259864 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.259702    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjnpv\" (UniqueName: \"kubernetes.io/projected/52af0cf8-7cb7-4473-9e0e-78a2608d2098-kube-api-access-bjnpv\") pod \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\" (UID: \"52af0cf8-7cb7-4473-9e0e-78a2608d2098\") "
Jul 02 19:54:32.260217 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260147    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:54:32.260324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260267    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-service-ca" (OuterVolumeSpecName: "service-ca") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:54:32.260324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260298    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:54:32.260324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260293    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-config" (OuterVolumeSpecName: "console-config") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 02 19:54:32.260518 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260489    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-oauth-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.260518 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260509    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-trusted-ca-bundle\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.260677 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260525    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-service-ca\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.260677 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.260540    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.261948 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.261919    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52af0cf8-7cb7-4473-9e0e-78a2608d2098-kube-api-access-bjnpv" (OuterVolumeSpecName: "kube-api-access-bjnpv") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "kube-api-access-bjnpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 19:54:32.262090 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.262058    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:54:32.262155 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.262092    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "52af0cf8-7cb7-4473-9e0e-78a2608d2098" (UID: "52af0cf8-7cb7-4473-9e0e-78a2608d2098"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 19:54:32.361633 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.361589    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjnpv\" (UniqueName: \"kubernetes.io/projected/52af0cf8-7cb7-4473-9e0e-78a2608d2098-kube-api-access-bjnpv\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.361633 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.361625    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-serving-cert\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.361633 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.361638    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/52af0cf8-7cb7-4473-9e0e-78a2608d2098-console-oauth-config\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 19:54:32.409183 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.409148    2562 generic.go:356] "Generic (PLEG): container finished" podID="52af0cf8-7cb7-4473-9e0e-78a2608d2098" containerID="32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192" exitCode=0
Jul 02 19:54:32.409325 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.409195    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9c874499-fcxts"
Jul 02 19:54:32.409325 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.409230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c874499-fcxts" event={"ID":"52af0cf8-7cb7-4473-9e0e-78a2608d2098","Type":"ContainerDied","Data":"32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192"}
Jul 02 19:54:32.409325 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.409280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9c874499-fcxts" event={"ID":"52af0cf8-7cb7-4473-9e0e-78a2608d2098","Type":"ContainerDied","Data":"212f6278bd95b67ac247edec4b4611aa98da1a8edc4205dabc26218a5565d600"}
Jul 02 19:54:32.409325 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.409304    2562 scope.go:117] "RemoveContainer" containerID="32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192"
Jul 02 19:54:32.417490 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.417472    2562 scope.go:117] "RemoveContainer" containerID="32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192"
Jul 02 19:54:32.417735 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:54:32.417718    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192\": container with ID starting with 32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192 not found: ID does not exist" containerID="32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192"
Jul 02 19:54:32.417778 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.417743    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192"} err="failed to get container status \"32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192\": rpc error: code = NotFound desc = could not find container \"32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192\": container with ID starting with 32d738fca3e88a6e2bc699f212d610ed9189d0dbca8c2a4f2715500a9cec6192 not found: ID does not exist"
Jul 02 19:54:32.425328 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.425275    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9c874499-fcxts"]
Jul 02 19:54:32.427142 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:32.427121    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d9c874499-fcxts"]
Jul 02 19:54:34.263336 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:34.263301    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52af0cf8-7cb7-4473-9e0e-78a2608d2098" path="/var/lib/kubelet/pods/52af0cf8-7cb7-4473-9e0e-78a2608d2098/volumes"
Jul 02 19:54:52.612434 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:52.612397    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:54:52.627835 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:52.627807    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:54:53.509539 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:54:53.509510    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 02 19:55:56.091616 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:55:56.091585    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 02 19:56:50.543638 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.543553    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k2wx5"]
Jul 02 19:56:50.544100 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.543849    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52af0cf8-7cb7-4473-9e0e-78a2608d2098" containerName="console"
Jul 02 19:56:50.544100 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.543860    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="52af0cf8-7cb7-4473-9e0e-78a2608d2098" containerName="console"
Jul 02 19:56:50.544100 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.543941    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="52af0cf8-7cb7-4473-9e0e-78a2608d2098" containerName="console"
Jul 02 19:56:50.546691 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.546674    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.549195 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.549167    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x4x4k\""
Jul 02 19:56:50.549402 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.549382    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 02 19:56:50.550064 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.550048    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 02 19:56:50.558823 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.558790    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k2wx5"]
Jul 02 19:56:50.650547 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.650508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bc239f1-32a7-46a5-9bd5-77e5f4a448d4-bound-sa-token\") pod \"cert-manager-55b4d954d5-k2wx5\" (UID: \"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4\") " pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.650752 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.650590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmw4m\" (UniqueName: \"kubernetes.io/projected/0bc239f1-32a7-46a5-9bd5-77e5f4a448d4-kube-api-access-gmw4m\") pod \"cert-manager-55b4d954d5-k2wx5\" (UID: \"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4\") " pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.751331 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.751298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmw4m\" (UniqueName: \"kubernetes.io/projected/0bc239f1-32a7-46a5-9bd5-77e5f4a448d4-kube-api-access-gmw4m\") pod \"cert-manager-55b4d954d5-k2wx5\" (UID: \"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4\") " pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.751509 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.751366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bc239f1-32a7-46a5-9bd5-77e5f4a448d4-bound-sa-token\") pod \"cert-manager-55b4d954d5-k2wx5\" (UID: \"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4\") " pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.759708 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.759675    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0bc239f1-32a7-46a5-9bd5-77e5f4a448d4-bound-sa-token\") pod \"cert-manager-55b4d954d5-k2wx5\" (UID: \"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4\") " pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.759845 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.759813    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmw4m\" (UniqueName: \"kubernetes.io/projected/0bc239f1-32a7-46a5-9bd5-77e5f4a448d4-kube-api-access-gmw4m\") pod \"cert-manager-55b4d954d5-k2wx5\" (UID: \"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4\") " pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:50.869605 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:50.869513    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-k2wx5"
Jul 02 19:56:51.006468 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:51.006433    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-k2wx5"]
Jul 02 19:56:51.010452 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:56:51.010430    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0bc239f1_32a7_46a5_9bd5_77e5f4a448d4.slice/crio-6dc1ab352b935bbecf8c4d8a01d2a4bb536e89fdad9d5332dd385641917d41fe WatchSource:0}: Error finding container 6dc1ab352b935bbecf8c4d8a01d2a4bb536e89fdad9d5332dd385641917d41fe: Status 404 returned error can't find the container with id 6dc1ab352b935bbecf8c4d8a01d2a4bb536e89fdad9d5332dd385641917d41fe
Jul 02 19:56:51.012525 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:51.012507    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 19:56:51.942481 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:56:51.942446    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k2wx5" event={"ID":"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4","Type":"ContainerStarted","Data":"6dc1ab352b935bbecf8c4d8a01d2a4bb536e89fdad9d5332dd385641917d41fe"}
Jul 02 19:57:00.985324 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:00.985280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-k2wx5" event={"ID":"0bc239f1-32a7-46a5-9bd5-77e5f4a448d4","Type":"ContainerStarted","Data":"d589909a321b329916020ce72d8822a2f8d46354a27a43a9cd322765da09be3b"}
Jul 02 19:57:01.006252 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:01.006192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-k2wx5" podStartSLOduration=1.725400703 podStartE2EDuration="11.006177055s" totalImagesPullingTime="9.280776352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:01.004061498 +0000 UTC m=+365.298944023" watchObservedRunningTime="2026-07-02 19:57:01.006177055 +0000 UTC m=+365.301059568"
Jul 02 19:57:03.928198 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.928161    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"]
Jul 02 19:57:03.931600 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.931579    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:03.937168 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.937142    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 02 19:57:03.940019 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.939993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rs4x8\""
Jul 02 19:57:03.940464 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.940447    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 02 19:57:03.940703 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.940690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 02 19:57:03.945608 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.945589    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 02 19:57:03.949448 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.949430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 02 19:57:03.956936 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:03.956906    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"]
Jul 02 19:57:04.065494 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.065453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47737ec4-ff1a-44d6-a16d-58d60110c22a-metrics-cert\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.065692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.065501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47737ec4-ff1a-44d6-a16d-58d60110c22a-cert\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.065692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.065559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgc52\" (UniqueName: \"kubernetes.io/projected/47737ec4-ff1a-44d6-a16d-58d60110c22a-kube-api-access-dgc52\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.065692 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.065586    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47737ec4-ff1a-44d6-a16d-58d60110c22a-manager-config\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.166351 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.166308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47737ec4-ff1a-44d6-a16d-58d60110c22a-cert\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.166557 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.166367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgc52\" (UniqueName: \"kubernetes.io/projected/47737ec4-ff1a-44d6-a16d-58d60110c22a-kube-api-access-dgc52\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.166557 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.166393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47737ec4-ff1a-44d6-a16d-58d60110c22a-manager-config\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.166557 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.166486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47737ec4-ff1a-44d6-a16d-58d60110c22a-metrics-cert\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.167204 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.167180    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/47737ec4-ff1a-44d6-a16d-58d60110c22a-manager-config\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.168869 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.168850    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/47737ec4-ff1a-44d6-a16d-58d60110c22a-metrics-cert\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.168940 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.168904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47737ec4-ff1a-44d6-a16d-58d60110c22a-cert\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.175329 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.175304    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgc52\" (UniqueName: \"kubernetes.io/projected/47737ec4-ff1a-44d6-a16d-58d60110c22a-kube-api-access-dgc52\") pod \"lws-controller-manager-7fc9d97d57-jjtrj\" (UID: \"47737ec4-ff1a-44d6-a16d-58d60110c22a\") " pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.242366 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.242333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:04.395897 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:04.395849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"]
Jul 02 19:57:04.398496 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:57:04.398468    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47737ec4_ff1a_44d6_a16d_58d60110c22a.slice/crio-4cb63a6e9eb653ecf0e9db1b9411b26141628b2e93b9a822ff70f1baf936905b WatchSource:0}: Error finding container 4cb63a6e9eb653ecf0e9db1b9411b26141628b2e93b9a822ff70f1baf936905b: Status 404 returned error can't find the container with id 4cb63a6e9eb653ecf0e9db1b9411b26141628b2e93b9a822ff70f1baf936905b
Jul 02 19:57:05.002644 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.002605    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj" event={"ID":"47737ec4-ff1a-44d6-a16d-58d60110c22a","Type":"ContainerStarted","Data":"4cb63a6e9eb653ecf0e9db1b9411b26141628b2e93b9a822ff70f1baf936905b"}
Jul 02 19:57:05.940926 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.940889    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"]
Jul 02 19:57:05.945759 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.945734    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:05.949766 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.949740    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 02 19:57:05.950158 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.950132    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 02 19:57:05.950293 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.950221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s6hdw\""
Jul 02 19:57:05.950293 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.950248    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 02 19:57:05.950960 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.950945    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 02 19:57:05.965244 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:05.965206    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"]
Jul 02 19:57:06.089157 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.089114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.089589 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.089168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.089589 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.089234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.089589 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.089262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkkfb\" (UniqueName: \"kubernetes.io/projected/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-kube-api-access-wkkfb\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.089589 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.089304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.189834 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.189798    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.189834 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.189839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.190101 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.189947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.190101 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.189985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkkfb\" (UniqueName: \"kubernetes.io/projected/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-kube-api-access-wkkfb\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.190101 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.190022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.190376 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.190355    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-manifests\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.192332 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.192269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-tmp\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.192490 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.192473    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.192545 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.192472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-webhook-cert\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.204062 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.204033    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkkfb\" (UniqueName: \"kubernetes.io/projected/1946bf43-d4bb-4ed8-bac0-3f604e9e3efb-kube-api-access-wkkfb\") pod \"opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f\" (UID: \"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb\") " pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.256553 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.256527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:06.406437 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:06.406400    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"]
Jul 02 19:57:06.409576 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:57:06.409544    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1946bf43_d4bb_4ed8_bac0_3f604e9e3efb.slice/crio-af233f12de5c56d4b4ff7ac60710037b27412a27ef5e25ed22b700f98f53b965 WatchSource:0}: Error finding container af233f12de5c56d4b4ff7ac60710037b27412a27ef5e25ed22b700f98f53b965: Status 404 returned error can't find the container with id af233f12de5c56d4b4ff7ac60710037b27412a27ef5e25ed22b700f98f53b965
Jul 02 19:57:07.013627 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:07.013570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f" event={"ID":"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb","Type":"ContainerStarted","Data":"af233f12de5c56d4b4ff7ac60710037b27412a27ef5e25ed22b700f98f53b965"}
Jul 02 19:57:11.036951 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:11.036914    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f" event={"ID":"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb","Type":"ContainerStarted","Data":"dfc76aae65479fab89dbde3737dffbfc3aa4f243f5ebafb62f978e718bcc8b4f"}
Jul 02 19:57:11.038718 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:11.038685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj" event={"ID":"47737ec4-ff1a-44d6-a16d-58d60110c22a","Type":"ContainerStarted","Data":"8d627a5f028480a7db83f22072540170fa1820a036d22ba94f82cf913016589c"}
Jul 02 19:57:11.038856 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:11.038833    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:11.093272 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:11.093215    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj" podStartSLOduration=1.889290844 podStartE2EDuration="8.093197197s" totalImagesPullingTime="6.203906353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:11.09211039 +0000 UTC m=+375.386992903" watchObservedRunningTime="2026-07-02 19:57:11.093197197 +0000 UTC m=+375.388079709"
Jul 02 19:57:12.044218 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:12.044182    2562 generic.go:356] "Generic (PLEG): container finished" podID="1946bf43-d4bb-4ed8-bac0-3f604e9e3efb" containerID="dfc76aae65479fab89dbde3737dffbfc3aa4f243f5ebafb62f978e718bcc8b4f" exitCode=0
Jul 02 19:57:12.044642 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:12.044228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f" event={"ID":"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb","Type":"ContainerDied","Data":"dfc76aae65479fab89dbde3737dffbfc3aa4f243f5ebafb62f978e718bcc8b4f"}
Jul 02 19:57:13.050194 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:13.050158    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f" event={"ID":"1946bf43-d4bb-4ed8-bac0-3f604e9e3efb","Type":"ContainerStarted","Data":"967b17ec5b7c3e68018eb8b3d89dc6161d4265e4c0334f2a9ba557be70fa94d0"}
Jul 02 19:57:13.050731 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:13.050299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:13.078757 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:13.078703    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f" podStartSLOduration=2.387127975 podStartE2EDuration="8.078685345s" totalImagesPullingTime="4.528955456s" totalInitContainerRuntime="1.162601914s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:13.076502614 +0000 UTC m=+377.371385130" watchObservedRunningTime="2026-07-02 19:57:13.078685345 +0000 UTC m=+377.373567858"
Jul 02 19:57:22.047492 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:22.047457    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fc9d97d57-jjtrj"
Jul 02 19:57:24.056868 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:24.056836    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f"
Jul 02 19:57:37.286076 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.286036    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"]
Jul 02 19:57:37.295485 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.295456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.298377 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.298349    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 02 19:57:37.299147 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.299121    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 02 19:57:37.299322 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.299305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 02 19:57:37.300579 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.300562    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 02 19:57:37.300656 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.300643    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9r2xv\""
Jul 02 19:57:37.310492 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.310464    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"]
Jul 02 19:57:37.360738 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.360704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e26e7195-9b5d-4c01-90a8-b84ff196ad53-tmp\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.360979 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.360869    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e26e7195-9b5d-4c01-90a8-b84ff196ad53-tls-certs\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.361105 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.361079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4mrl\" (UniqueName: \"kubernetes.io/projected/e26e7195-9b5d-4c01-90a8-b84ff196ad53-kube-api-access-d4mrl\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.461941 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.461899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4mrl\" (UniqueName: \"kubernetes.io/projected/e26e7195-9b5d-4c01-90a8-b84ff196ad53-kube-api-access-d4mrl\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.462164 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.461967    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e26e7195-9b5d-4c01-90a8-b84ff196ad53-tmp\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.462164 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.462059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e26e7195-9b5d-4c01-90a8-b84ff196ad53-tls-certs\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.464460 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.464435    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e26e7195-9b5d-4c01-90a8-b84ff196ad53-tmp\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.464591 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.464572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e26e7195-9b5d-4c01-90a8-b84ff196ad53-tls-certs\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.472586 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.472553    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4mrl\" (UniqueName: \"kubernetes.io/projected/e26e7195-9b5d-4c01-90a8-b84ff196ad53-kube-api-access-d4mrl\") pod \"kube-auth-proxy-79ff5d7d55-tqkw9\" (UID: \"e26e7195-9b5d-4c01-90a8-b84ff196ad53\") " pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.605810 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.605712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"
Jul 02 19:57:37.793781 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:37.793758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9"]
Jul 02 19:57:37.796043 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:57:37.796017    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode26e7195_9b5d_4c01_90a8_b84ff196ad53.slice/crio-2d6a4b10a147908f66b45aa68082359c54fe98ce9c73f77d936ad0141a94fee3 WatchSource:0}: Error finding container 2d6a4b10a147908f66b45aa68082359c54fe98ce9c73f77d936ad0141a94fee3: Status 404 returned error can't find the container with id 2d6a4b10a147908f66b45aa68082359c54fe98ce9c73f77d936ad0141a94fee3
Jul 02 19:57:38.159049 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:38.159001    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9" event={"ID":"e26e7195-9b5d-4c01-90a8-b84ff196ad53","Type":"ContainerStarted","Data":"2d6a4b10a147908f66b45aa68082359c54fe98ce9c73f77d936ad0141a94fee3"}
Jul 02 19:57:41.175643 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:41.175603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9" event={"ID":"e26e7195-9b5d-4c01-90a8-b84ff196ad53","Type":"ContainerStarted","Data":"acb34364f5c2c477ca15ed16e904c864194750304592823c5c4c59f633b00c7a"}
Jul 02 19:57:41.206032 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:57:41.205976    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79ff5d7d55-tqkw9" podStartSLOduration=1.476633044 podStartE2EDuration="4.205960588s" totalImagesPullingTime="2.729327544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:41.205351841 +0000 UTC m=+405.500234355" watchObservedRunningTime="2026-07-02 19:57:41.205960588 +0000 UTC m=+405.500843118"
Jul 02 19:59:12.347094 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.347055    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"]
Jul 02 19:59:12.350398 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.350379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:12.353102 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.353074    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 02 19:59:12.354087 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.354064    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-g6bqp\""
Jul 02 19:59:12.354228 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.354071    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 02 19:59:12.354228 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.354071    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 02 19:59:12.369958 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.369925    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"]
Jul 02 19:59:12.403147 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.403116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5x2x\" (UniqueName: \"kubernetes.io/projected/1589b080-6386-4202-ae71-4e1b452dc8eb-kube-api-access-q5x2x\") pod \"dns-operator-controller-manager-864dd78c4c-s26r7\" (UID: \"1589b080-6386-4202-ae71-4e1b452dc8eb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:12.504383 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.504349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5x2x\" (UniqueName: \"kubernetes.io/projected/1589b080-6386-4202-ae71-4e1b452dc8eb-kube-api-access-q5x2x\") pod \"dns-operator-controller-manager-864dd78c4c-s26r7\" (UID: \"1589b080-6386-4202-ae71-4e1b452dc8eb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:12.516143 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.516118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5x2x\" (UniqueName: \"kubernetes.io/projected/1589b080-6386-4202-ae71-4e1b452dc8eb-kube-api-access-q5x2x\") pod \"dns-operator-controller-manager-864dd78c4c-s26r7\" (UID: \"1589b080-6386-4202-ae71-4e1b452dc8eb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:12.661109 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.661011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:12.798939 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:12.798905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"]
Jul 02 19:59:12.801955 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:59:12.801928    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1589b080_6386_4202_ae71_4e1b452dc8eb.slice/crio-5f2e10d081b12b4cb87b322ad20af4e7ceda7823057cc09aa1b9f6305516b9fb WatchSource:0}: Error finding container 5f2e10d081b12b4cb87b322ad20af4e7ceda7823057cc09aa1b9f6305516b9fb: Status 404 returned error can't find the container with id 5f2e10d081b12b4cb87b322ad20af4e7ceda7823057cc09aa1b9f6305516b9fb
Jul 02 19:59:13.601096 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:13.601054    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7" event={"ID":"1589b080-6386-4202-ae71-4e1b452dc8eb","Type":"ContainerStarted","Data":"5f2e10d081b12b4cb87b322ad20af4e7ceda7823057cc09aa1b9f6305516b9fb"}
Jul 02 19:59:15.612507 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:15.612472    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7" event={"ID":"1589b080-6386-4202-ae71-4e1b452dc8eb","Type":"ContainerStarted","Data":"ad4c4a14bf6e7b42c572a5577e49f2f7e31072734e41a71d26b3c113aba8bd60"}
Jul 02 19:59:15.612923 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:15.612596    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:15.631760 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:15.631706    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7" podStartSLOduration=1.59487413 podStartE2EDuration="3.631689682s" totalImagesPullingTime="2.036815552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:15.629900569 +0000 UTC m=+499.924783076" watchObservedRunningTime="2026-07-02 19:59:15.631689682 +0000 UTC m=+499.926572279"
Jul 02 19:59:18.772983 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.772941    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"]
Jul 02 19:59:18.776401 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.776381    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.781047 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.781020    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6kbnp\""
Jul 02 19:59:18.781197 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.781020    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 02 19:59:18.781197 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.781026    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 02 19:59:18.860231 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.860180    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"]
Jul 02 19:59:18.861660 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.861583    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.861827 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.861729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.861827 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.861772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgx95\" (UniqueName: \"kubernetes.io/projected/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-kube-api-access-lgx95\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.962305 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.962264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.962532 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.962367    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.962532 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.962401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgx95\" (UniqueName: \"kubernetes.io/projected/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-kube-api-access-lgx95\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.962532 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:59:18.962419    2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 02 19:59:18.962532 ip-10-0-143-37 kubenswrapper[2562]: E0702 19:59:18.962514    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-plugin-serving-cert podName:8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8 nodeName:}" failed. No retries permitted until 2026-07-02 19:59:19.462494695 +0000 UTC m=+503.757377186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-98bg8" (UID: "8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8") : secret "plugin-serving-cert" not found
Jul 02 19:59:18.963204 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.963185    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:18.982460 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:18.982432    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgx95\" (UniqueName: \"kubernetes.io/projected/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-kube-api-access-lgx95\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:19.467248 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:19.467206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:19.469720 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:19.469695    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-98bg8\" (UID: \"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:19.686264 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:19.686224    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"
Jul 02 19:59:19.822334 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:19.822227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8"]
Jul 02 19:59:19.824999 ip-10-0-143-37 kubenswrapper[2562]: W0702 19:59:19.824971    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e184b60_5aaf_4d7a_b747_5f8e61bc7ac8.slice/crio-c94de905161493b9eb0454486a3c90a83b15f3c3d8db7488ff958aa4c9bc33d8 WatchSource:0}: Error finding container c94de905161493b9eb0454486a3c90a83b15f3c3d8db7488ff958aa4c9bc33d8: Status 404 returned error can't find the container with id c94de905161493b9eb0454486a3c90a83b15f3c3d8db7488ff958aa4c9bc33d8
Jul 02 19:59:20.636471 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:20.636430    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8" event={"ID":"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8","Type":"ContainerStarted","Data":"c94de905161493b9eb0454486a3c90a83b15f3c3d8db7488ff958aa4c9bc33d8"}
Jul 02 19:59:26.619402 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:26.619365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-s26r7"
Jul 02 19:59:43.775458 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:43.775414    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8" event={"ID":"8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8","Type":"ContainerStarted","Data":"4093569a73ed48de12a37ebca6c1fcd751995aef42785032bc859e7ff2c7fd48"}
Jul 02 19:59:43.801340 ip-10-0-143-37 kubenswrapper[2562]: I0702 19:59:43.801289    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-98bg8" podStartSLOduration=2.473555292 podStartE2EDuration="25.801273716s" totalImagesPullingTime="23.327718424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:43.799953923 +0000 UTC m=+528.094836437" watchObservedRunningTime="2026-07-02 19:59:43.801273716 +0000 UTC m=+528.096156280"
Jul 02 20:00:15.180385 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.180348    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:00:15.217649 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.217617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:00:15.217807 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.217659    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:00:15.217807 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.217725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.220358 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.220335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 02 20:00:15.383698 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.383645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcss9\" (UniqueName: \"kubernetes.io/projected/e659cc6f-7e89-418c-9520-20e4c4ae531c-kube-api-access-lcss9\") pod \"limitador-limitador-54d6d988d5-tltnw\" (UID: \"e659cc6f-7e89-418c-9520-20e4c4ae531c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.383911 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.383723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e659cc6f-7e89-418c-9520-20e4c4ae531c-config-file\") pod \"limitador-limitador-54d6d988d5-tltnw\" (UID: \"e659cc6f-7e89-418c-9520-20e4c4ae531c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.484726 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.484637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcss9\" (UniqueName: \"kubernetes.io/projected/e659cc6f-7e89-418c-9520-20e4c4ae531c-kube-api-access-lcss9\") pod \"limitador-limitador-54d6d988d5-tltnw\" (UID: \"e659cc6f-7e89-418c-9520-20e4c4ae531c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.484726 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.484688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e659cc6f-7e89-418c-9520-20e4c4ae531c-config-file\") pod \"limitador-limitador-54d6d988d5-tltnw\" (UID: \"e659cc6f-7e89-418c-9520-20e4c4ae531c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.485301 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.485282    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e659cc6f-7e89-418c-9520-20e4c4ae531c-config-file\") pod \"limitador-limitador-54d6d988d5-tltnw\" (UID: \"e659cc6f-7e89-418c-9520-20e4c4ae531c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.493599 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.493566    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcss9\" (UniqueName: \"kubernetes.io/projected/e659cc6f-7e89-418c-9520-20e4c4ae531c-kube-api-access-lcss9\") pod \"limitador-limitador-54d6d988d5-tltnw\" (UID: \"e659cc6f-7e89-418c-9520-20e4c4ae531c\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.527647 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.527611    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:15.668454 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.668427    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:00:15.671093 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:00:15.671060    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode659cc6f_7e89_418c_9520_20e4c4ae531c.slice/crio-223034887dccfdfd5776ba371c23da61026f8a2e882bd8088feb5991c1c7c5fb WatchSource:0}: Error finding container 223034887dccfdfd5776ba371c23da61026f8a2e882bd8088feb5991c1c7c5fb: Status 404 returned error can't find the container with id 223034887dccfdfd5776ba371c23da61026f8a2e882bd8088feb5991c1c7c5fb
Jul 02 20:00:15.917528 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:15.917493    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw" event={"ID":"e659cc6f-7e89-418c-9520-20e4c4ae531c","Type":"ContainerStarted","Data":"223034887dccfdfd5776ba371c23da61026f8a2e882bd8088feb5991c1c7c5fb"}
Jul 02 20:00:18.935803 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:18.935762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw" event={"ID":"e659cc6f-7e89-418c-9520-20e4c4ae531c","Type":"ContainerStarted","Data":"526c9987f30627fb87c8e09dfd817cb8b8237d0097d3fbbc2959e7b05378ea27"}
Jul 02 20:00:18.936216 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:18.935908    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:00:18.955316 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:18.955260    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw" podStartSLOduration=1.322922452 podStartE2EDuration="3.95524109s" totalImagesPullingTime="2.632318638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:18.953251636 +0000 UTC m=+563.248134164" watchObservedRunningTime="2026-07-02 20:00:18.95524109 +0000 UTC m=+563.250123603"
Jul 02 20:00:29.940988 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:00:29.940937    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tltnw"
Jul 02 20:01:27.104783 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:01:27.104743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:01:49.148055 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:01:49.148019    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:02:04.400694 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:04.400661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:02:09.594359 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:09.594323    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:02:25.930270 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.930230    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"]
Jul 02 20:02:25.934293 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.934267    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:25.937017 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.936987    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 02 20:02:25.937187 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.937123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zdt7w\""
Jul 02 20:02:25.937846 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.937823    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 02 20:02:25.937966 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.937869    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 02 20:02:25.945643 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:25.945611    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"]
Jul 02 20:02:26.044397 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.044354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.044397 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.044400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4psgr\" (UniqueName: \"kubernetes.io/projected/916f17c1-10c0-4296-822c-cd62c7886b59-kube-api-access-4psgr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.044626 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.044434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916f17c1-10c0-4296-822c-cd62c7886b59-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.044626 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.044472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.044626 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.044492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.044626 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.044515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145354 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145354 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4psgr\" (UniqueName: \"kubernetes.io/projected/916f17c1-10c0-4296-822c-cd62c7886b59-kube-api-access-4psgr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145577 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916f17c1-10c0-4296-822c-cd62c7886b59-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145577 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145577 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145577 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.145899 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145854    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.146024 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145870    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.146024 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.145919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.148029 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.148005    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/916f17c1-10c0-4296-822c-cd62c7886b59-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.148546 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.148528    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/916f17c1-10c0-4296-822c-cd62c7886b59-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.156674 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.156646    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4psgr\" (UniqueName: \"kubernetes.io/projected/916f17c1-10c0-4296-822c-cd62c7886b59-kube-api-access-4psgr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884\" (UID: \"916f17c1-10c0-4296-822c-cd62c7886b59\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.245668 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.245624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:26.395905 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.395855    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"]
Jul 02 20:02:26.399653 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:02:26.399623    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916f17c1_10c0_4296_822c_cd62c7886b59.slice/crio-aed32bb968f0199bd8110abd3e8e13336e1b2ce695940d69ce82f40ae2c4c0d0 WatchSource:0}: Error finding container aed32bb968f0199bd8110abd3e8e13336e1b2ce695940d69ce82f40ae2c4c0d0: Status 404 returned error can't find the container with id aed32bb968f0199bd8110abd3e8e13336e1b2ce695940d69ce82f40ae2c4c0d0
Jul 02 20:02:26.400856 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.400834    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 02 20:02:26.528004 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:26.527902    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884" event={"ID":"916f17c1-10c0-4296-822c-cd62c7886b59","Type":"ContainerStarted","Data":"aed32bb968f0199bd8110abd3e8e13336e1b2ce695940d69ce82f40ae2c4c0d0"}
Jul 02 20:02:27.534664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:27.534635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884" event={"ID":"916f17c1-10c0-4296-822c-cd62c7886b59","Type":"ContainerStarted","Data":"acd2f4fde31dd3813a1e38888bb56b3576921fe29256476f843afa609b6212d5"}
Jul 02 20:02:27.558374 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:27.558332    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:02:27.568049 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:27.567990    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884" podStartSLOduration=1.500520069 podStartE2EDuration="2.567971143s" totalImagesPullingTime="1.067451074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:27.567528082 +0000 UTC m=+691.862410598" watchObservedRunningTime="2026-07-02 20:02:27.567971143 +0000 UTC m=+691.862853655"
Jul 02 20:02:36.246642 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:36.246599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:36.247250 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:36.246690    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:36.264791 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:36.264764    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:36.586810 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:36.586719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884"
Jul 02 20:02:42.900773 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:42.900737    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:02:45.602529 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.602493    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"]
Jul 02 20:02:45.608271 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.608249    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.612756 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.612731    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 02 20:02:45.636506 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.636471    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"]
Jul 02 20:02:45.730851 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.730809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.730851 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.730851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.731112 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.730912    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.731112 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.730978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.731112 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.731015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqt7r\" (UniqueName: \"kubernetes.io/projected/c03c3061-0594-4924-95b3-73631090339c-kube-api-access-qqt7r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.731112 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.731107    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03c3061-0594-4924-95b3-73631090339c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.831883 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.831846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832047 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.831948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832047 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.831984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832047 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.832011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqt7r\" (UniqueName: \"kubernetes.io/projected/c03c3061-0594-4924-95b3-73631090339c-kube-api-access-qqt7r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832197 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.832108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03c3061-0594-4924-95b3-73631090339c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832197 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.832161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832323 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.832302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832381 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.832339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.832447 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.832433    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.834340 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.834308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03c3061-0594-4924-95b3-73631090339c-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.834490 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.834469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03c3061-0594-4924-95b3-73631090339c-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.850406 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.850375    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqt7r\" (UniqueName: \"kubernetes.io/projected/c03c3061-0594-4924-95b3-73631090339c-kube-api-access-qqt7r\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h\" (UID: \"c03c3061-0594-4924-95b3-73631090339c\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:45.917723 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:45.917630    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:46.086736 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:46.086708    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"]
Jul 02 20:02:46.088960 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:02:46.088930    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc03c3061_0594_4924_95b3_73631090339c.slice/crio-8c0b1a0cb0b01c27fc877ed382b58ebf055d2a465fcd16e0d717cb656e42d491 WatchSource:0}: Error finding container 8c0b1a0cb0b01c27fc877ed382b58ebf055d2a465fcd16e0d717cb656e42d491: Status 404 returned error can't find the container with id 8c0b1a0cb0b01c27fc877ed382b58ebf055d2a465fcd16e0d717cb656e42d491
Jul 02 20:02:46.621920 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:46.621863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h" event={"ID":"c03c3061-0594-4924-95b3-73631090339c","Type":"ContainerStarted","Data":"afbb37db8b89b26a8b9ad4787cae7a88132c36b6a1f114675f2131166731334d"}
Jul 02 20:02:46.622412 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:46.621929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h" event={"ID":"c03c3061-0594-4924-95b3-73631090339c","Type":"ContainerStarted","Data":"8c0b1a0cb0b01c27fc877ed382b58ebf055d2a465fcd16e0d717cb656e42d491"}
Jul 02 20:02:46.669306 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:46.669180    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h" podStartSLOduration=1.346550975 podStartE2EDuration="1.669163044s" totalImagesPullingTime="322.612069ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:46.667489506 +0000 UTC m=+710.962372022" watchObservedRunningTime="2026-07-02 20:02:46.669163044 +0000 UTC m=+710.964045557"
Jul 02 20:02:53.537548 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:53.537460    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:02:55.918701 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:55.918661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:55.919240 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:55.918824    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:55.931309 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:55.931274    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:02:56.681140 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:02:56.681109    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h"
Jul 02 20:04:28.002818 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:04:28.002737    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:04:38.911333 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:04:38.911296    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:04:50.112610 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:04:50.112577    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:04:58.705824 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:04:58.705786    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:05:09.102977 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:05:09.102940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:05:36.391449 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:05:36.391411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:05:47.694906 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:05:47.694862    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:05:59.885104 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:05:59.885065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:06:19.486522 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:06:19.486489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:06:29.400818 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:06:29.400780    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:06:37.884493 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:06:37.884455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:06:49.391857 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:06:49.391818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:06:59.143173 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:06:59.143136    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:07:09.990320 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:07:09.990286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:07:19.984484 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:07:19.984399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:07:29.486279 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:07:29.486238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:07:52.281674 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:07:52.281638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:08:00.998585 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:08:00.998538    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:08:24.094457 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:08:24.094422    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:08:36.489188 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:08:36.489152    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:08:51.492792 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:08:51.492712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:09:00.194401 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:09:00.194354    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:09:09.689776 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:09:09.689730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:09:18.696169 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:09:18.696128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:09:28.587748 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:09:28.587711    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:11:19.303253 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:11:19.303215    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:11:29.196150 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:11:29.196107    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:11:39.406295 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:11:39.406257    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:11:50.698190 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:11:50.698146    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:12:01.292685 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:12:01.292649    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:12:12.685516 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:12:12.685476    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:12:21.188194 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:12:21.188154    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:12:31.900088 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:12:31.900051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:12:43.194728 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:12:43.194694    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:12:52.088114 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:12:52.088079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:13:05.590354 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:13:05.590313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:13:22.697562 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:13:22.697478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:13:31.993939 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:13:31.993900    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:13:41.293071 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:13:41.293028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:13:53.387907 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:13:53.387857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:14:09.889487 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:14:09.889447    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:14:20.701341 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:14:20.701303    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:14:29.489458 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:14:29.489420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:14:39.494407 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:14:39.494370    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:14:48.392230 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:14:48.392143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:14:59.185395 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:14:59.185358    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:15:12.190154 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:15:12.190112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:15:20.787115 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:15:20.787065    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:15:31.190784 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:15:31.190747    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:15:40.686694 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:15:40.686654    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:15:53.090067 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:15:53.090031    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:16:02.794457 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:16:02.794415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:16:13.987313 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:16:13.987274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:16:25.599943 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:16:25.599833    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:16:36.285290 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:16:36.285255    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:16:48.384227 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:16:48.384188    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:16:57.486168 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:16:57.486129    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:17:05.004532 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:17:05.004492    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:17:24.886657 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:17:24.886622    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:17:34.397559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:17:34.397523    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:19:13.887939 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:19:13.887904    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:19:21.290853 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:19:21.290765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:19:30.203029 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:19:30.202976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:19:39.995969 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:19:39.995933    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:19:47.201476 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:19:47.201443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:20:16.600362 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:16.600326    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:20:27.890018 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.889983    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"]
Jul 02 20:20:27.893794 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.893770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:27.896213 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.896192    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b80982bb\"/\"kube-root-ca.crt\""
Jul 02 20:20:27.896326 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.896193    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-b80982bb\"/\"openshift-service-ca.crt\""
Jul 02 20:20:27.897201 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.897181    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b80982bb\"/\"e2e-lifecycle-model-b80982bb-kserve-self-signed-certs\""
Jul 02 20:20:27.897291 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.897214    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-b80982bb\"/\"default-dockercfg-dvtv7\""
Jul 02 20:20:27.903311 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:27.903287    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"]
Jul 02 20:20:28.010549 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.010503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b6hk\" (UniqueName: \"kubernetes.io/projected/70dc76a4-1b4d-4558-b502-a848dbb9b67b-kube-api-access-4b6hk\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.010549 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.010557    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-home\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.010812 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.010580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-dshm\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.010812 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.010703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tls-certs\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.010812 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.010746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-model-cache\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.010812 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.010774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tmp-dir\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.111448 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tls-certs\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.111448 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-model-cache\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.111693 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tmp-dir\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.111693 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b6hk\" (UniqueName: \"kubernetes.io/projected/70dc76a4-1b4d-4558-b502-a848dbb9b67b-kube-api-access-4b6hk\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.111693 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-home\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.111693 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-dshm\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.112158 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.111971    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-model-cache\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.112158 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.112042    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-home\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.112158 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.112075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tmp-dir\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.113887 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.113853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-dshm\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.114058 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.114040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tls-certs\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.119630 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.119607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b6hk\" (UniqueName: \"kubernetes.io/projected/70dc76a4-1b4d-4558-b502-a848dbb9b67b-kube-api-access-4b6hk\") pod \"e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") " pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.204580 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.204492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:28.339091 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.339062    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"]
Jul 02 20:20:28.341677 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:20:28.341635    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod70dc76a4_1b4d_4558_b502_a848dbb9b67b.slice/crio-7b453e03bfd36d0a7917f22cb75826e5083aee11f7c1cd1ad45e92f25894e8ba WatchSource:0}: Error finding container 7b453e03bfd36d0a7917f22cb75826e5083aee11f7c1cd1ad45e92f25894e8ba: Status 404 returned error can't find the container with id 7b453e03bfd36d0a7917f22cb75826e5083aee11f7c1cd1ad45e92f25894e8ba
Jul 02 20:20:28.591558 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.591519    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt" event={"ID":"70dc76a4-1b4d-4558-b502-a848dbb9b67b","Type":"ContainerStarted","Data":"1dd43f834e6db04d5090b8b336080c6a8c63a4fbd601dd1512d3c8c0db6cfa77"}
Jul 02 20:20:28.591744 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.591570    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt" event={"ID":"70dc76a4-1b4d-4558-b502-a848dbb9b67b","Type":"ContainerStarted","Data":"7b453e03bfd36d0a7917f22cb75826e5083aee11f7c1cd1ad45e92f25894e8ba"}
Jul 02 20:20:28.608092 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:28.608038    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt" podStartSLOduration=1.608021932 podStartE2EDuration="1.608021932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:20:28.607012412 +0000 UTC m=+1772.901894902" watchObservedRunningTime="2026-07-02 20:20:28.608021932 +0000 UTC m=+1772.902904445"
Jul 02 20:20:30.986849 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:30.986799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:20:38.205477 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:38.205440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:38.206037 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:38.205500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:38.217923 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:38.217870    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:38.648471 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:38.648437    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:20:52.189920 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:20:52.189812    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:21:05.697205 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:05.697163    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"]
Jul 02 20:21:06.084013 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:06.083975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:21:20.717404 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:20.717346    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt" podUID="70dc76a4-1b4d-4558-b502-a848dbb9b67b" containerName="main" containerID="cri-o://1dd43f834e6db04d5090b8b336080c6a8c63a4fbd601dd1512d3c8c0db6cfa77" gracePeriod=45
Jul 02 20:21:20.833287 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:20.833257    2562 generic.go:356] "Generic (PLEG): container finished" podID="70dc76a4-1b4d-4558-b502-a848dbb9b67b" containerID="1dd43f834e6db04d5090b8b336080c6a8c63a4fbd601dd1512d3c8c0db6cfa77" exitCode=0
Jul 02 20:21:20.833436 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:20.833331    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt" event={"ID":"70dc76a4-1b4d-4558-b502-a848dbb9b67b","Type":"ContainerDied","Data":"1dd43f834e6db04d5090b8b336080c6a8c63a4fbd601dd1512d3c8c0db6cfa77"}
Jul 02 20:21:20.983847 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:20.983818    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:21:21.096055 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096011    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-dshm\") pod \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") "
Jul 02 20:21:21.096055 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096053    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tmp-dir\") pod \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") "
Jul 02 20:21:21.096326 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096108    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tls-certs\") pod \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") "
Jul 02 20:21:21.096326 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4b6hk\" (UniqueName: \"kubernetes.io/projected/70dc76a4-1b4d-4558-b502-a848dbb9b67b-kube-api-access-4b6hk\") pod \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") "
Jul 02 20:21:21.096326 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096195    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-home\") pod \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") "
Jul 02 20:21:21.096326 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096243    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-model-cache\") pod \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\" (UID: \"70dc76a4-1b4d-4558-b502-a848dbb9b67b\") "
Jul 02 20:21:21.096521 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096389    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "70dc76a4-1b4d-4558-b502-a848dbb9b67b" (UID: "70dc76a4-1b4d-4558-b502-a848dbb9b67b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:21.096584 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096557    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-home" (OuterVolumeSpecName: "home") pod "70dc76a4-1b4d-4558-b502-a848dbb9b67b" (UID: "70dc76a4-1b4d-4558-b502-a848dbb9b67b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:21.096584 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096551    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-model-cache" (OuterVolumeSpecName: "model-cache") pod "70dc76a4-1b4d-4558-b502-a848dbb9b67b" (UID: "70dc76a4-1b4d-4558-b502-a848dbb9b67b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:21.096679 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.096610    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:21:21.098365 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.098339    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-dshm" (OuterVolumeSpecName: "dshm") pod "70dc76a4-1b4d-4558-b502-a848dbb9b67b" (UID: "70dc76a4-1b4d-4558-b502-a848dbb9b67b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:21:21.098479 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.098403    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "70dc76a4-1b4d-4558-b502-a848dbb9b67b" (UID: "70dc76a4-1b4d-4558-b502-a848dbb9b67b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:21:21.098479 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.098406    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70dc76a4-1b4d-4558-b502-a848dbb9b67b-kube-api-access-4b6hk" (OuterVolumeSpecName: "kube-api-access-4b6hk") pod "70dc76a4-1b4d-4558-b502-a848dbb9b67b" (UID: "70dc76a4-1b4d-4558-b502-a848dbb9b67b"). InnerVolumeSpecName "kube-api-access-4b6hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:21:21.197182 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.197149    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70dc76a4-1b4d-4558-b502-a848dbb9b67b-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:21:21.197182 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.197180    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4b6hk\" (UniqueName: \"kubernetes.io/projected/70dc76a4-1b4d-4558-b502-a848dbb9b67b-kube-api-access-4b6hk\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:21:21.197182 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.197189    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:21:21.197403 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.197199    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:21:21.197403 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.197207    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70dc76a4-1b4d-4558-b502-a848dbb9b67b-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:21:21.840486 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.840454    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"
Jul 02 20:21:21.840939 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.840498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt" event={"ID":"70dc76a4-1b4d-4558-b502-a848dbb9b67b","Type":"ContainerDied","Data":"7b453e03bfd36d0a7917f22cb75826e5083aee11f7c1cd1ad45e92f25894e8ba"}
Jul 02 20:21:21.840939 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.840551    2562 scope.go:117] "RemoveContainer" containerID="1dd43f834e6db04d5090b8b336080c6a8c63a4fbd601dd1512d3c8c0db6cfa77"
Jul 02 20:21:21.862197 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.862163    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"]
Jul 02 20:21:21.870931 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:21.868145    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-b80982bb/e2e-lifecycle-model-b80982bb-kserve-847594ff99-x74zt"]
Jul 02 20:21:22.264781 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:22.264744    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70dc76a4-1b4d-4558-b502-a848dbb9b67b" path="/var/lib/kubelet/pods/70dc76a4-1b4d-4558-b502-a848dbb9b67b/volumes"
Jul 02 20:21:45.290130 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:21:45.290097    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:22:54.088561 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:22:54.088517    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:23:03.506786 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:03.506735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:23:19.497690 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.497657    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"]
Jul 02 20:23:19.498200 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.498108    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70dc76a4-1b4d-4558-b502-a848dbb9b67b" containerName="main"
Jul 02 20:23:19.498200 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.498123    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="70dc76a4-1b4d-4558-b502-a848dbb9b67b" containerName="main"
Jul 02 20:23:19.498200 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.498182    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="70dc76a4-1b4d-4558-b502-a848dbb9b67b" containerName="main"
Jul 02 20:23:19.501245 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.501225    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.504668 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.504637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ba0616\"/\"default-dockercfg-l6hth\""
Jul 02 20:23:19.504668 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.504660    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ba0616\"/\"test-model-ba0616-kserve-self-signed-certs\""
Jul 02 20:23:19.504852 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.504690    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ba0616\"/\"kube-root-ca.crt\""
Jul 02 20:23:19.504852 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.504746    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ba0616\"/\"openshift-service-ca.crt\""
Jul 02 20:23:19.510738 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.510713    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"]
Jul 02 20:23:19.595583 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.595540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-home\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.595767 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.595593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-dshm\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.595767 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.595611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-model-cache\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.595767 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.595671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxdvz\" (UniqueName: \"kubernetes.io/projected/b315aec1-ce34-4f60-9b6b-a39879517a37-kube-api-access-vxdvz\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.595767 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.595692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b315aec1-ce34-4f60-9b6b-a39879517a37-tls-certs\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.595767 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.595755    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-tmp-dir\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.696565 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.696520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-dshm\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.696565 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.696562    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-model-cache\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.696794 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.696604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxdvz\" (UniqueName: \"kubernetes.io/projected/b315aec1-ce34-4f60-9b6b-a39879517a37-kube-api-access-vxdvz\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.696794 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.696624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b315aec1-ce34-4f60-9b6b-a39879517a37-tls-certs\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.696794 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.696653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-tmp-dir\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.696794 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.696699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-home\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.697120 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.697088    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-model-cache\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.697120 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.697119    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-home\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.697282 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.697164    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-tmp-dir\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.698939 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.698912    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-dshm\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.699323 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.699300    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b315aec1-ce34-4f60-9b6b-a39879517a37-tls-certs\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.705586 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.705559    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxdvz\" (UniqueName: \"kubernetes.io/projected/b315aec1-ce34-4f60-9b6b-a39879517a37-kube-api-access-vxdvz\") pod \"test-model-ba0616-kserve-59b76c5445-5jhzd\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") " pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.812089 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.811982    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:19.947989 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:19.947960    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"]
Jul 02 20:23:19.950129 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:23:19.950096    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb315aec1_ce34_4f60_9b6b_a39879517a37.slice/crio-837fd3d486d89e658dbc0c199a6d792a536abe2168bfb98176696ba62ea28e9d WatchSource:0}: Error finding container 837fd3d486d89e658dbc0c199a6d792a536abe2168bfb98176696ba62ea28e9d: Status 404 returned error can't find the container with id 837fd3d486d89e658dbc0c199a6d792a536abe2168bfb98176696ba62ea28e9d
Jul 02 20:23:20.389751 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:20.389713    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd" event={"ID":"b315aec1-ce34-4f60-9b6b-a39879517a37","Type":"ContainerStarted","Data":"637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7"}
Jul 02 20:23:20.389751 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:20.389755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd" event={"ID":"b315aec1-ce34-4f60-9b6b-a39879517a37","Type":"ContainerStarted","Data":"837fd3d486d89e658dbc0c199a6d792a536abe2168bfb98176696ba62ea28e9d"}
Jul 02 20:23:20.408416 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:20.408361    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd" podStartSLOduration=1.408344097 podStartE2EDuration="1.408344097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:23:20.406486105 +0000 UTC m=+1944.701368644" watchObservedRunningTime="2026-07-02 20:23:20.408344097 +0000 UTC m=+1944.703226610"
Jul 02 20:23:22.496304 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:22.496265    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:23:29.812779 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:29.812737    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:29.812779 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:29.812791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:29.825237 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:29.825205    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:30.451156 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:30.451122    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:23:41.895218 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.895176    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"]
Jul 02 20:23:41.898963 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.898939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.902452 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.902427    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a3a257\"/\"kube-root-ca.crt\""
Jul 02 20:23:41.902581 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.902434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a3a257\"/\"test-model-a3a257-kserve-self-signed-certs\""
Jul 02 20:23:41.902581 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.902502    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a3a257\"/\"default-dockercfg-jf2tn\""
Jul 02 20:23:41.902581 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.902538    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a3a257\"/\"openshift-service-ca.crt\""
Jul 02 20:23:41.907664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tls-certs\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.907664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tmp-dir\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.907664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907459    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-home\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.907664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-dshm\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.907664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-model-cache\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.907664 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzhrw\" (UniqueName: \"kubernetes.io/projected/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-kube-api-access-tzhrw\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:41.907960 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:41.907705    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"]
Jul 02 20:23:42.008306 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008269    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tmp-dir\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008306 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-home\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008572 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-dshm\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008572 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-model-cache\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008572 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008376    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzhrw\" (UniqueName: \"kubernetes.io/projected/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-kube-api-access-tzhrw\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008572 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tls-certs\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008815 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008785    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-home\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008908 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-model-cache\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.008908 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.008870    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tmp-dir\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.010731 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.010706    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-dshm\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.010999 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.010983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tls-certs\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.016244 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.016220    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzhrw\" (UniqueName: \"kubernetes.io/projected/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-kube-api-access-tzhrw\") pod \"test-model-a3a257-kserve-7c874dddcf-kzlps\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") " pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.210270 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.210178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:42.345718 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.345680    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"]
Jul 02 20:23:42.349886 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:23:42.349842    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2d653a1_14d6_4dd5_9fd6_790d5b0a3f7a.slice/crio-cb09e3140296ff5edf9b729e2db5fcb87dddb0fb857ac93afacd398d52db9770 WatchSource:0}: Error finding container cb09e3140296ff5edf9b729e2db5fcb87dddb0fb857ac93afacd398d52db9770: Status 404 returned error can't find the container with id cb09e3140296ff5edf9b729e2db5fcb87dddb0fb857ac93afacd398d52db9770
Jul 02 20:23:42.505604 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.505566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps" event={"ID":"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a","Type":"ContainerStarted","Data":"2c7a89f9b467d9ad3ab7cf943ed7f01ac7d6484b6f40da53a470f73d3f820926"}
Jul 02 20:23:42.505793 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.505612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps" event={"ID":"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a","Type":"ContainerStarted","Data":"cb09e3140296ff5edf9b729e2db5fcb87dddb0fb857ac93afacd398d52db9770"}
Jul 02 20:23:42.522798 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:42.522743    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps" podStartSLOduration=1.5227301610000001 podStartE2EDuration="1.522730161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:23:42.521432191 +0000 UTC m=+1966.816314703" watchObservedRunningTime="2026-07-02 20:23:42.522730161 +0000 UTC m=+1966.817612673"
Jul 02 20:23:45.592584 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:45.592544    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:23:52.211039 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:52.210934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:52.211039 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:52.210989    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:52.223386 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:52.223366    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:52.570553 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:52.570520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:23:58.586404 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:23:58.586370    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:24:12.617097 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:12.617063    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"]
Jul 02 20:24:13.566662 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:13.566622    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"]
Jul 02 20:24:16.999196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:16.999160    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:24:27.638208 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.638142    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd" podUID="b315aec1-ce34-4f60-9b6b-a39879517a37" containerName="main" containerID="cri-o://637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7" gracePeriod=45
Jul 02 20:24:27.905696 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.905672    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:24:27.936122 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936087    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-dshm\") pod \"b315aec1-ce34-4f60-9b6b-a39879517a37\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") "
Jul 02 20:24:27.936332 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936166    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-model-cache\") pod \"b315aec1-ce34-4f60-9b6b-a39879517a37\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") "
Jul 02 20:24:27.936332 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936200    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b315aec1-ce34-4f60-9b6b-a39879517a37-tls-certs\") pod \"b315aec1-ce34-4f60-9b6b-a39879517a37\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") "
Jul 02 20:24:27.936332 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936222    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-home\") pod \"b315aec1-ce34-4f60-9b6b-a39879517a37\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") "
Jul 02 20:24:27.936332 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936246    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxdvz\" (UniqueName: \"kubernetes.io/projected/b315aec1-ce34-4f60-9b6b-a39879517a37-kube-api-access-vxdvz\") pod \"b315aec1-ce34-4f60-9b6b-a39879517a37\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") "
Jul 02 20:24:27.936332 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936282    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-tmp-dir\") pod \"b315aec1-ce34-4f60-9b6b-a39879517a37\" (UID: \"b315aec1-ce34-4f60-9b6b-a39879517a37\") "
Jul 02 20:24:27.936651 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936493    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-model-cache" (OuterVolumeSpecName: "model-cache") pod "b315aec1-ce34-4f60-9b6b-a39879517a37" (UID: "b315aec1-ce34-4f60-9b6b-a39879517a37"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:27.936651 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936506    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-home" (OuterVolumeSpecName: "home") pod "b315aec1-ce34-4f60-9b6b-a39879517a37" (UID: "b315aec1-ce34-4f60-9b6b-a39879517a37"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:27.936651 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936649    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:27.936825 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936652    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b315aec1-ce34-4f60-9b6b-a39879517a37" (UID: "b315aec1-ce34-4f60-9b6b-a39879517a37"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:27.936825 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.936668    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:27.939086 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.939061    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-dshm" (OuterVolumeSpecName: "dshm") pod "b315aec1-ce34-4f60-9b6b-a39879517a37" (UID: "b315aec1-ce34-4f60-9b6b-a39879517a37"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:27.939225 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.939105    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b315aec1-ce34-4f60-9b6b-a39879517a37-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b315aec1-ce34-4f60-9b6b-a39879517a37" (UID: "b315aec1-ce34-4f60-9b6b-a39879517a37"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:24:27.939225 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:27.939107    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b315aec1-ce34-4f60-9b6b-a39879517a37-kube-api-access-vxdvz" (OuterVolumeSpecName: "kube-api-access-vxdvz") pod "b315aec1-ce34-4f60-9b6b-a39879517a37" (UID: "b315aec1-ce34-4f60-9b6b-a39879517a37"). InnerVolumeSpecName "kube-api-access-vxdvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:24:28.037559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.037523    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:28.037559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.037554    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b315aec1-ce34-4f60-9b6b-a39879517a37-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:28.037559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.037566    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxdvz\" (UniqueName: \"kubernetes.io/projected/b315aec1-ce34-4f60-9b6b-a39879517a37-kube-api-access-vxdvz\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:28.037559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.037575    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b315aec1-ce34-4f60-9b6b-a39879517a37-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:28.587526 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.587422    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps" podUID="d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" containerName="main" containerID="cri-o://2c7a89f9b467d9ad3ab7cf943ed7f01ac7d6484b6f40da53a470f73d3f820926" gracePeriod=45
Jul 02 20:24:28.735397 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.735354    2562 generic.go:356] "Generic (PLEG): container finished" podID="b315aec1-ce34-4f60-9b6b-a39879517a37" containerID="637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7" exitCode=0
Jul 02 20:24:28.735909 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.735416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"
Jul 02 20:24:28.735909 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.735443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd" event={"ID":"b315aec1-ce34-4f60-9b6b-a39879517a37","Type":"ContainerDied","Data":"637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7"}
Jul 02 20:24:28.735909 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.735488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd" event={"ID":"b315aec1-ce34-4f60-9b6b-a39879517a37","Type":"ContainerDied","Data":"837fd3d486d89e658dbc0c199a6d792a536abe2168bfb98176696ba62ea28e9d"}
Jul 02 20:24:28.735909 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.735509    2562 scope.go:117] "RemoveContainer" containerID="637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7"
Jul 02 20:24:28.737292 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.737273    2562 generic.go:356] "Generic (PLEG): container finished" podID="d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" containerID="2c7a89f9b467d9ad3ab7cf943ed7f01ac7d6484b6f40da53a470f73d3f820926" exitCode=0
Jul 02 20:24:28.737397 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.737334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps" event={"ID":"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a","Type":"ContainerDied","Data":"2c7a89f9b467d9ad3ab7cf943ed7f01ac7d6484b6f40da53a470f73d3f820926"}
Jul 02 20:24:28.745030 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.744942    2562 scope.go:117] "RemoveContainer" containerID="637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7"
Jul 02 20:24:28.745292 ip-10-0-143-37 kubenswrapper[2562]: E0702 20:24:28.745265    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7\": container with ID starting with 637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7 not found: ID does not exist" containerID="637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7"
Jul 02 20:24:28.745352 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.745300    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7"} err="failed to get container status \"637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7\": rpc error: code = NotFound desc = could not find container \"637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7\": container with ID starting with 637a7531db2da7cd6501efc0a325620e071dd9b6799949704203e2a8efdd90d7 not found: ID does not exist"
Jul 02 20:24:28.752213 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.752186    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"]
Jul 02 20:24:28.753910 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.753887    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ba0616/test-model-ba0616-kserve-59b76c5445-5jhzd"]
Jul 02 20:24:28.845674 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.845604    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:24:28.946892 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.946852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-model-cache\") pod \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") "
Jul 02 20:24:28.947196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.946936    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-home\") pod \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") "
Jul 02 20:24:28.947196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.946976    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzhrw\" (UniqueName: \"kubernetes.io/projected/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-kube-api-access-tzhrw\") pod \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") "
Jul 02 20:24:28.947196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947010    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-dshm\") pod \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") "
Jul 02 20:24:28.947196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tls-certs\") pod \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") "
Jul 02 20:24:28.947196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tmp-dir\") pod \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\" (UID: \"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a\") "
Jul 02 20:24:28.947481 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947183    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" (UID: "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:28.947481 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947263    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-home" (OuterVolumeSpecName: "home") pod "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" (UID: "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:28.947481 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947392    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" (UID: "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:28.947481 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947427    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:28.947481 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.947446    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:28.949369 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.949345    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-kube-api-access-tzhrw" (OuterVolumeSpecName: "kube-api-access-tzhrw") pod "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" (UID: "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a"). InnerVolumeSpecName "kube-api-access-tzhrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:24:28.949369 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.949350    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-dshm" (OuterVolumeSpecName: "dshm") pod "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" (UID: "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:24:28.949515 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:28.949373    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" (UID: "d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:24:29.048775 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.048728    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:29.048775 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.048763    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:29.048775 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.048774    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzhrw\" (UniqueName: \"kubernetes.io/projected/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-kube-api-access-tzhrw\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:29.048775 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.048783    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:24:29.742891 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.742836    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"
Jul 02 20:24:29.743381 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.742866    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps" event={"ID":"d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a","Type":"ContainerDied","Data":"cb09e3140296ff5edf9b729e2db5fcb87dddb0fb857ac93afacd398d52db9770"}
Jul 02 20:24:29.743381 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.742950    2562 scope.go:117] "RemoveContainer" containerID="2c7a89f9b467d9ad3ab7cf943ed7f01ac7d6484b6f40da53a470f73d3f820926"
Jul 02 20:24:29.765622 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.765589    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"]
Jul 02 20:24:29.769053 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:29.769022    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a3a257/test-model-a3a257-kserve-7c874dddcf-kzlps"]
Jul 02 20:24:30.264793 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:30.264755    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b315aec1-ce34-4f60-9b6b-a39879517a37" path="/var/lib/kubelet/pods/b315aec1-ce34-4f60-9b6b-a39879517a37/volumes"
Jul 02 20:24:30.265224 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:24:30.265209    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" path="/var/lib/kubelet/pods/d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a/volumes"
Jul 02 20:25:00.386655 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:25:00.386616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:25:10.793892 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:25:10.793840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:25:24.197774 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:25:24.197688    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:25:35.330656 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:25:35.330615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:25:45.291584 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:25:45.291543    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:25:56.100125 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:25:56.100089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:26:04.695440 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:04.695404    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:26:14.490617 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.490580    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"]
Jul 02 20:26:14.491253 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.491176    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" containerName="main"
Jul 02 20:26:14.491253 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.491197    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" containerName="main"
Jul 02 20:26:14.491253 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.491211    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b315aec1-ce34-4f60-9b6b-a39879517a37" containerName="main"
Jul 02 20:26:14.491253 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.491223    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b315aec1-ce34-4f60-9b6b-a39879517a37" containerName="main"
Jul 02 20:26:14.491464 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.491294    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2d653a1-14d6-4dd5-9fd6-790d5b0a3f7a" containerName="main"
Jul 02 20:26:14.491464 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.491311    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b315aec1-ce34-4f60-9b6b-a39879517a37" containerName="main"
Jul 02 20:26:14.494370 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.494346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.497609 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.497580    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"kube-root-ca.crt\""
Jul 02 20:26:14.497753 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.497637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"default-dockercfg-ntp2s\""
Jul 02 20:26:14.497753 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.497637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"auth-test-model-3136f3-kserve-self-signed-certs\""
Jul 02 20:26:14.497753 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.497646    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"openshift-service-ca.crt\""
Jul 02 20:26:14.502844 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.502818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"]
Jul 02 20:26:14.613396 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.613356    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwgv\" (UniqueName: \"kubernetes.io/projected/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-kube-api-access-gtwgv\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.613579 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.613408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tmp-dir\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.613579 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.613481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tls-certs\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.613579 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.613501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-home\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.613579 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.613517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-model-cache\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.613579 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.613566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-dshm\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.714699 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.714656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tls-certs\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.714699 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.714694    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-home\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.714982 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.714713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-model-cache\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.714982 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.714751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-dshm\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.714982 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.714823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwgv\" (UniqueName: \"kubernetes.io/projected/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-kube-api-access-gtwgv\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.714982 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.714862    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tmp-dir\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.715185 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.715134    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-home\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.715245 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.715179    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-model-cache\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.715245 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.715228    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tmp-dir\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.717070 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.717050    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-dshm\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.717367 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.717352    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tls-certs\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.722413 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.722390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwgv\" (UniqueName: \"kubernetes.io/projected/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-kube-api-access-gtwgv\") pod \"auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") " pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.804531 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.804428    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:14.942820 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:14.942720    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"]
Jul 02 20:26:14.946198 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:26:14.946167    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf48e9fcf_0a13_4440_9a6c_6c0e426e3df1.slice/crio-b3a279c14248c12d1a72c7516ecb1aac0c1329fb806488664c176b4a1b3b602d WatchSource:0}: Error finding container b3a279c14248c12d1a72c7516ecb1aac0c1329fb806488664c176b4a1b3b602d: Status 404 returned error can't find the container with id b3a279c14248c12d1a72c7516ecb1aac0c1329fb806488664c176b4a1b3b602d
Jul 02 20:26:15.239675 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:15.239642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv" event={"ID":"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1","Type":"ContainerStarted","Data":"91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2"}
Jul 02 20:26:15.239963 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:15.239689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv" event={"ID":"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1","Type":"ContainerStarted","Data":"b3a279c14248c12d1a72c7516ecb1aac0c1329fb806488664c176b4a1b3b602d"}
Jul 02 20:26:15.259312 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:15.259241    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv" podStartSLOduration=1.259222047 podStartE2EDuration="1.259222047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:26:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:26:15.257371718 +0000 UTC m=+2119.552254231" watchObservedRunningTime="2026-07-02 20:26:15.259222047 +0000 UTC m=+2119.554104561"
Jul 02 20:26:17.590787 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:17.590751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:26:24.805363 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:24.805321    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:24.805748 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:24.805385    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:24.817814 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:24.817785    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:25.297846 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:25.297816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:26:38.589731 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.589696    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"]
Jul 02 20:26:38.592927 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.592906    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.596421 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.596400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"openshift-service-ca.crt\""
Jul 02 20:26:38.596539 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.596473    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"auth-test-model-c7f980-kserve-self-signed-certs\""
Jul 02 20:26:38.596539 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.596503    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"default-dockercfg-hrfvc\""
Jul 02 20:26:38.596649 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.596564    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"kube-root-ca.crt\""
Jul 02 20:26:38.603591 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.603569    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"]
Jul 02 20:26:38.638009 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.637963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tmp-dir\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.638009 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.638005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tls-certs\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.638261 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.638027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-model-cache\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.638261 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.638129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-dshm\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.638261 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.638162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-home\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.638261 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.638184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6ln\" (UniqueName: \"kubernetes.io/projected/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-kube-api-access-zw6ln\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739382 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-dshm\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739507 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-home\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739507 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6ln\" (UniqueName: \"kubernetes.io/projected/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-kube-api-access-zw6ln\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739507 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tmp-dir\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739507 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tls-certs\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739661 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-model-cache\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.739926 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739862    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-home\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.740086 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739946    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tmp-dir\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.740086 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.739989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-model-cache\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.741764 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.741742    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-dshm\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.742009 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.741988    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tls-certs\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.747800 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.747770    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6ln\" (UniqueName: \"kubernetes.io/projected/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-kube-api-access-zw6ln\") pod \"auth-test-model-c7f980-kserve-584687d867-4v7hx\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") " pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:38.903432 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:38.903339    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:39.037847 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:39.037813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"]
Jul 02 20:26:39.041072 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:26:39.041034    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode292d8eb_1663_45a7_8c9d_26a76ff5f55a.slice/crio-fa469d9e1b2c79ae3729cf50d14a8fd84aeeda3df4944fed0d54d0fac76bf8c5 WatchSource:0}: Error finding container fa469d9e1b2c79ae3729cf50d14a8fd84aeeda3df4944fed0d54d0fac76bf8c5: Status 404 returned error can't find the container with id fa469d9e1b2c79ae3729cf50d14a8fd84aeeda3df4944fed0d54d0fac76bf8c5
Jul 02 20:26:39.357185 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:39.357144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx" event={"ID":"e292d8eb-1663-45a7-8c9d-26a76ff5f55a","Type":"ContainerStarted","Data":"1906ead73cd4a5ef2ba3df5cd8d119dcb9ad8ec2e2568a077299f68b66241ac7"}
Jul 02 20:26:39.357185 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:39.357192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx" event={"ID":"e292d8eb-1663-45a7-8c9d-26a76ff5f55a","Type":"ContainerStarted","Data":"fa469d9e1b2c79ae3729cf50d14a8fd84aeeda3df4944fed0d54d0fac76bf8c5"}
Jul 02 20:26:39.375867 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:39.375808    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx" podStartSLOduration=1.375790161 podStartE2EDuration="1.375790161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:26:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:26:39.374637089 +0000 UTC m=+2143.669519606" watchObservedRunningTime="2026-07-02 20:26:39.375790161 +0000 UTC m=+2143.670672674"
Jul 02 20:26:42.092075 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:42.092022    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:26:48.904056 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:48.903964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:48.904056 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:48.904036    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:48.916842 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:48.916808    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:49.414522 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:49.414489    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:26:55.589953 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:26:55.589917    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:27:09.099976 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:27:09.099940    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:27:26.391333 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:27:26.391296    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:27:43.295717 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:27:43.295676    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:27:59.582790 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:27:59.582751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:28:16.198094 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:16.198056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:28:29.655675 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:29.655587    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"]
Jul 02 20:28:30.672079 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:30.672041    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"]
Jul 02 20:28:33.395659 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:33.395619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:28:44.676002 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.675937    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv" podUID="f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" containerName="main" containerID="cri-o://91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2" gracePeriod=45
Jul 02 20:28:44.930868 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.930805    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:28:44.943425 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.943388    2562 generic.go:356] "Generic (PLEG): container finished" podID="f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" containerID="91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2" exitCode=0
Jul 02 20:28:44.943599 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.943434    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"
Jul 02 20:28:44.943599 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.943482    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv" event={"ID":"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1","Type":"ContainerDied","Data":"91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2"}
Jul 02 20:28:44.943599 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.943529    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv" event={"ID":"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1","Type":"ContainerDied","Data":"b3a279c14248c12d1a72c7516ecb1aac0c1329fb806488664c176b4a1b3b602d"}
Jul 02 20:28:44.943599 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.943550    2562 scope.go:117] "RemoveContainer" containerID="91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2"
Jul 02 20:28:44.953945 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.953921    2562 scope.go:117] "RemoveContainer" containerID="91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2"
Jul 02 20:28:44.954278 ip-10-0-143-37 kubenswrapper[2562]: E0702 20:28:44.954255    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2\": container with ID starting with 91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2 not found: ID does not exist" containerID="91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2"
Jul 02 20:28:44.954344 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:44.954292    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2"} err="failed to get container status \"91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2\": rpc error: code = NotFound desc = could not find container \"91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2\": container with ID starting with 91f61cd9ce4ac373fb381bc08e6429b53663b1b24ae508555e1b19b951879ce2 not found: ID does not exist"
Jul 02 20:28:45.115732 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.115695    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-home\") pod \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") "
Jul 02 20:28:45.115732 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.115735    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-dshm\") pod \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") "
Jul 02 20:28:45.116034 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.115755    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-model-cache\") pod \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") "
Jul 02 20:28:45.116034 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.115807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtwgv\" (UniqueName: \"kubernetes.io/projected/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-kube-api-access-gtwgv\") pod \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") "
Jul 02 20:28:45.116034 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.115832    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tmp-dir\") pod \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") "
Jul 02 20:28:45.116034 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.115951    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tls-certs\") pod \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\" (UID: \"f48e9fcf-0a13-4440-9a6c-6c0e426e3df1\") "
Jul 02 20:28:45.116273 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.116044    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-home" (OuterVolumeSpecName: "home") pod "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" (UID: "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:45.116273 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.116114    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-model-cache" (OuterVolumeSpecName: "model-cache") pod "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" (UID: "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:45.116273 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.116152    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" (UID: "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:45.116404 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.116284    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:45.116404 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.116297    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:45.116404 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.116306    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:45.118063 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.118035    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-dshm" (OuterVolumeSpecName: "dshm") pod "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" (UID: "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:45.118160 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.118065    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" (UID: "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:28:45.118160 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.118113    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-kube-api-access-gtwgv" (OuterVolumeSpecName: "kube-api-access-gtwgv") pod "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" (UID: "f48e9fcf-0a13-4440-9a6c-6c0e426e3df1"). InnerVolumeSpecName "kube-api-access-gtwgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:28:45.217494 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.217409    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:45.217494 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.217444    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtwgv\" (UniqueName: \"kubernetes.io/projected/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-kube-api-access-gtwgv\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:45.217494 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.217456    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:45.265543 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.265507    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"]
Jul 02 20:28:45.269724 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.269693    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/auth-test-model-3136f3-kserve-5dbdd99ff5-6rqqv"]
Jul 02 20:28:45.692768 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.692708    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx" podUID="e292d8eb-1663-45a7-8c9d-26a76ff5f55a" containerName="main" containerID="cri-o://1906ead73cd4a5ef2ba3df5cd8d119dcb9ad8ec2e2568a077299f68b66241ac7" gracePeriod=45
Jul 02 20:28:45.950424 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.950347    2562 generic.go:356] "Generic (PLEG): container finished" podID="e292d8eb-1663-45a7-8c9d-26a76ff5f55a" containerID="1906ead73cd4a5ef2ba3df5cd8d119dcb9ad8ec2e2568a077299f68b66241ac7" exitCode=0
Jul 02 20:28:45.950592 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.950425    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx" event={"ID":"e292d8eb-1663-45a7-8c9d-26a76ff5f55a","Type":"ContainerDied","Data":"1906ead73cd4a5ef2ba3df5cd8d119dcb9ad8ec2e2568a077299f68b66241ac7"}
Jul 02 20:28:45.950592 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.950475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx" event={"ID":"e292d8eb-1663-45a7-8c9d-26a76ff5f55a","Type":"ContainerDied","Data":"fa469d9e1b2c79ae3729cf50d14a8fd84aeeda3df4944fed0d54d0fac76bf8c5"}
Jul 02 20:28:45.950592 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.950491    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa469d9e1b2c79ae3729cf50d14a8fd84aeeda3df4944fed0d54d0fac76bf8c5"
Jul 02 20:28:45.957999 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:45.957973    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:28:46.126796 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.126758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-home\") pod \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") "
Jul 02 20:28:46.127033 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.126823    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tls-certs\") pod \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") "
Jul 02 20:28:46.127033 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.126841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-dshm\") pod \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") "
Jul 02 20:28:46.127033 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.126914    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tmp-dir\") pod \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") "
Jul 02 20:28:46.127033 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.126958    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-model-cache\") pod \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") "
Jul 02 20:28:46.127033 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.126987    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zw6ln\" (UniqueName: \"kubernetes.io/projected/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-kube-api-access-zw6ln\") pod \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\" (UID: \"e292d8eb-1663-45a7-8c9d-26a76ff5f55a\") "
Jul 02 20:28:46.127316 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.127163    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-home" (OuterVolumeSpecName: "home") pod "e292d8eb-1663-45a7-8c9d-26a76ff5f55a" (UID: "e292d8eb-1663-45a7-8c9d-26a76ff5f55a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:46.127316 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.127237    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-model-cache" (OuterVolumeSpecName: "model-cache") pod "e292d8eb-1663-45a7-8c9d-26a76ff5f55a" (UID: "e292d8eb-1663-45a7-8c9d-26a76ff5f55a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:46.127316 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.127248    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e292d8eb-1663-45a7-8c9d-26a76ff5f55a" (UID: "e292d8eb-1663-45a7-8c9d-26a76ff5f55a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:46.127470 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.127348    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:46.127470 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.127367    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:46.127470 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.127376    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:46.129200 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.129175    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-kube-api-access-zw6ln" (OuterVolumeSpecName: "kube-api-access-zw6ln") pod "e292d8eb-1663-45a7-8c9d-26a76ff5f55a" (UID: "e292d8eb-1663-45a7-8c9d-26a76ff5f55a"). InnerVolumeSpecName "kube-api-access-zw6ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:28:46.129200 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.129188    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e292d8eb-1663-45a7-8c9d-26a76ff5f55a" (UID: "e292d8eb-1663-45a7-8c9d-26a76ff5f55a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:28:46.129334 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.129232    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-dshm" (OuterVolumeSpecName: "dshm") pod "e292d8eb-1663-45a7-8c9d-26a76ff5f55a" (UID: "e292d8eb-1663-45a7-8c9d-26a76ff5f55a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:28:46.228503 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.228411    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:46.228503 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.228447    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:46.228503 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.228456    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zw6ln\" (UniqueName: \"kubernetes.io/projected/e292d8eb-1663-45a7-8c9d-26a76ff5f55a-kube-api-access-zw6ln\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:28:46.265030 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.264998    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" path="/var/lib/kubelet/pods/f48e9fcf-0a13-4440-9a6c-6c0e426e3df1/volumes"
Jul 02 20:28:46.956052 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.956024    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"
Jul 02 20:28:46.972928 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.972890    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"]
Jul 02 20:28:46.979299 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:46.979259    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/auth-test-model-c7f980-kserve-584687d867-4v7hx"]
Jul 02 20:28:48.264622 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:48.264586    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e292d8eb-1663-45a7-8c9d-26a76ff5f55a" path="/var/lib/kubelet/pods/e292d8eb-1663-45a7-8c9d-26a76ff5f55a/volumes"
Jul 02 20:28:49.586916 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:28:49.586863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:29:16.379774 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.379728    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"]
Jul 02 20:29:16.380319 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.380303    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" containerName="main"
Jul 02 20:29:16.380363 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.380324    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" containerName="main"
Jul 02 20:29:16.380363 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.380345    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e292d8eb-1663-45a7-8c9d-26a76ff5f55a" containerName="main"
Jul 02 20:29:16.380363 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.380352    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e292d8eb-1663-45a7-8c9d-26a76ff5f55a" containerName="main"
Jul 02 20:29:16.380453 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.380445    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f48e9fcf-0a13-4440-9a6c-6c0e426e3df1" containerName="main"
Jul 02 20:29:16.380490 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.380464    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e292d8eb-1663-45a7-8c9d-26a76ff5f55a" containerName="main"
Jul 02 20:29:16.383689 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.383673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.387114 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.387090    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"openshift-service-ca.crt\""
Jul 02 20:29:16.387272 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.387223    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"default-dockercfg-hrfvc\""
Jul 02 20:29:16.387272 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.387232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"kube-root-ca.crt\""
Jul 02 20:29:16.387272 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.387224    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"sub-test-model-c7f980-kserve-self-signed-certs\""
Jul 02 20:29:16.394435 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.394407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"]
Jul 02 20:29:16.509001 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.508967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tls-certs\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.509001 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.509007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5qjx\" (UniqueName: \"kubernetes.io/projected/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-kube-api-access-p5qjx\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.509227 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.509046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-model-cache\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.509227 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.509114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-dshm\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.509227 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.509145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tmp-dir\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.509227 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.509174    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-home\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610379 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tls-certs\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610379 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5qjx\" (UniqueName: \"kubernetes.io/projected/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-kube-api-access-p5qjx\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610633 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610421    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-model-cache\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610633 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-dshm\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610633 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tmp-dir\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610633 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-home\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.610953 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-model-cache\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.611078 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.610981    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tmp-dir\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.611078 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.611021    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-home\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.612700 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.612668    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-dshm\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.612991 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.612976    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tls-certs\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.618098 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.618079    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5qjx\" (UniqueName: \"kubernetes.io/projected/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-kube-api-access-p5qjx\") pod \"sub-test-model-c7f980-kserve-76bb85d569-rcvkh\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") " pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.693024 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.692929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:16.836693 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:16.836661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"]
Jul 02 20:29:16.839381 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:29:16.839351    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5500998a_2ac5_4fa8_9c8a_b20fc3fd6bd7.slice/crio-fe7eb739494cae5a7d3634a0b9bb2475201e278ad6951f8b653532e622f4e290 WatchSource:0}: Error finding container fe7eb739494cae5a7d3634a0b9bb2475201e278ad6951f8b653532e622f4e290: Status 404 returned error can't find the container with id fe7eb739494cae5a7d3634a0b9bb2475201e278ad6951f8b653532e622f4e290
Jul 02 20:29:17.096186 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:17.096145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh" event={"ID":"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7","Type":"ContainerStarted","Data":"49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9"}
Jul 02 20:29:17.096353 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:17.096195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh" event={"ID":"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7","Type":"ContainerStarted","Data":"fe7eb739494cae5a7d3634a0b9bb2475201e278ad6951f8b653532e622f4e290"}
Jul 02 20:29:17.114823 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:17.114770    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh" podStartSLOduration=1.114753979 podStartE2EDuration="1.114753979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:29:17.114019156 +0000 UTC m=+2301.408901706" watchObservedRunningTime="2026-07-02 20:29:17.114753979 +0000 UTC m=+2301.409636490"
Jul 02 20:29:20.392689 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:20.392650    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:29:26.693305 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:26.693265    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:26.693813 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:26.693329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:26.705346 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:26.705317    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:27.155934 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:27.155902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:29:34.396587 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:34.396548    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:29:50.081662 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:50.081575    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:29:56.997224 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:29:56.997188    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"]
Jul 02 20:30:01.099363 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.099328    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"]
Jul 02 20:30:01.103281 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.103258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.106896 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.106856    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"default-dockercfg-ntp2s\""
Jul 02 20:30:01.106896 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.106870    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"kube-root-ca.crt\""
Jul 02 20:30:01.107108 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.106905    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"openshift-service-ca.crt\""
Jul 02 20:30:01.107108 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.106869    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3136f3\"/\"rate-test-model-3136f3-kserve-self-signed-certs\""
Jul 02 20:30:01.112461 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.112439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"]
Jul 02 20:30:01.223642 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.223608    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-home\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.223642 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.223639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-model-cache\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.223899 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.223660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tmp-dir\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.223899 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.223685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58rfj\" (UniqueName: \"kubernetes.io/projected/0382b4aa-62f3-4727-98c8-f5ef829e4c47-kube-api-access-58rfj\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.223899 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.223799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tls-certs\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.224027 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.223907    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-dshm\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.324553 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.324520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tmp-dir\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.324553 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.324558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58rfj\" (UniqueName: \"kubernetes.io/projected/0382b4aa-62f3-4727-98c8-f5ef829e4c47-kube-api-access-58rfj\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.324839 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.324589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tls-certs\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.324839 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.324706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-dshm\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.324839 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.324768    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-home\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.324839 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.324790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-model-cache\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.325071 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.325041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tmp-dir\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.325194 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.325173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-model-cache\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.325255 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.325186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-home\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.327049 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.327011    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-dshm\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.327232 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.327215    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tls-certs\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.333841 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.333809    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58rfj\" (UniqueName: \"kubernetes.io/projected/0382b4aa-62f3-4727-98c8-f5ef829e4c47-kube-api-access-58rfj\") pod \"rate-test-model-3136f3-kserve-848c54464c-p4ns5\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") " pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.414196 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.414105    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:01.549436 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:01.549408    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"]
Jul 02 20:30:01.551645 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:30:01.551607    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0382b4aa_62f3_4727_98c8_f5ef829e4c47.slice/crio-6832acbbbd6d4395f4b4e429ca9595c1fa984ecc0c7a7d8697d4e86a57a93125 WatchSource:0}: Error finding container 6832acbbbd6d4395f4b4e429ca9595c1fa984ecc0c7a7d8697d4e86a57a93125: Status 404 returned error can't find the container with id 6832acbbbd6d4395f4b4e429ca9595c1fa984ecc0c7a7d8697d4e86a57a93125
Jul 02 20:30:02.311905 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:02.311853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5" event={"ID":"0382b4aa-62f3-4727-98c8-f5ef829e4c47","Type":"ContainerStarted","Data":"5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691"}
Jul 02 20:30:02.312318 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:02.311915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5" event={"ID":"0382b4aa-62f3-4727-98c8-f5ef829e4c47","Type":"ContainerStarted","Data":"6832acbbbd6d4395f4b4e429ca9595c1fa984ecc0c7a7d8697d4e86a57a93125"}
Jul 02 20:30:02.329427 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:02.329375    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5" podStartSLOduration=1.329358547 podStartE2EDuration="1.329358547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:02.327480729 +0000 UTC m=+2346.622363245" watchObservedRunningTime="2026-07-02 20:30:02.329358547 +0000 UTC m=+2346.624241059"
Jul 02 20:30:07.393724 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:07.393687    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:30:11.415162 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:11.415121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:11.415628 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:11.415465    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:11.427647 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:11.427622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:12.017278 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.017212    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh" podUID="5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" containerName="main" containerID="cri-o://49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9" gracePeriod=45
Jul 02 20:30:12.272787 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.272725    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:30:12.361142 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.361111    2562 generic.go:356] "Generic (PLEG): container finished" podID="5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" containerID="49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9" exitCode=0
Jul 02 20:30:12.361346 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.361151    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"
Jul 02 20:30:12.361346 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.361196    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh" event={"ID":"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7","Type":"ContainerDied","Data":"49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9"}
Jul 02 20:30:12.361346 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.361238    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh" event={"ID":"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7","Type":"ContainerDied","Data":"fe7eb739494cae5a7d3634a0b9bb2475201e278ad6951f8b653532e622f4e290"}
Jul 02 20:30:12.361346 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.361261    2562 scope.go:117] "RemoveContainer" containerID="49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9"
Jul 02 20:30:12.371250 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.371229    2562 scope.go:117] "RemoveContainer" containerID="49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9"
Jul 02 20:30:12.371581 ip-10-0-143-37 kubenswrapper[2562]: E0702 20:30:12.371559    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9\": container with ID starting with 49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9 not found: ID does not exist" containerID="49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9"
Jul 02 20:30:12.371647 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.371592    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9"} err="failed to get container status \"49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9\": rpc error: code = NotFound desc = could not find container \"49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9\": container with ID starting with 49a0c2f36907dbd2407e817835861b88044a1fd55a413e53309fe228e19225b9 not found: ID does not exist"
Jul 02 20:30:12.374756 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.374737    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:30:12.435582 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tmp-dir\") pod \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") "
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435616    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-model-cache\") pod \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") "
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435645    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-home\") pod \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") "
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-dshm\") pod \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") "
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435768    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tls-certs\") pod \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") "
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435791    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5qjx\" (UniqueName: \"kubernetes.io/projected/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-kube-api-access-p5qjx\") pod \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\" (UID: \"5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7\") "
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435913    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" (UID: "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.435928    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-model-cache" (OuterVolumeSpecName: "model-cache") pod "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" (UID: "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:12.436090 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.436059    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-home" (OuterVolumeSpecName: "home") pod "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" (UID: "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:12.436421 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.436217    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:30:12.436421 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.436249    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:30:12.436421 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.436258    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:30:12.438145 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.438121    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" (UID: "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:30:12.438284 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.438272    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-dshm" (OuterVolumeSpecName: "dshm") pod "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" (UID: "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:30:12.438441 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.438423    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-kube-api-access-p5qjx" (OuterVolumeSpecName: "kube-api-access-p5qjx") pod "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" (UID: "5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7"). InnerVolumeSpecName "kube-api-access-p5qjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:30:12.537846 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.537751    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:30:12.537846 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.537787    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5qjx\" (UniqueName: \"kubernetes.io/projected/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-kube-api-access-p5qjx\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:30:12.537846 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.537800    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:30:12.683132 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.683100    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"]
Jul 02 20:30:12.689147 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:12.689119    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/sub-test-model-c7f980-kserve-76bb85d569-rcvkh"]
Jul 02 20:30:14.264995 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:14.264959    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" path="/var/lib/kubelet/pods/5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7/volumes"
Jul 02 20:30:53.991276 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.991243    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"]
Jul 02 20:30:53.991737 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.991614    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" containerName="main"
Jul 02 20:30:53.991737 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.991625    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" containerName="main"
Jul 02 20:30:53.991737 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.991688    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5500998a-2ac5-4fa8-9c8a-b20fc3fd6bd7" containerName="main"
Jul 02 20:30:53.994715 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.994698    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:53.998280 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.998255    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"default-dockercfg-hrfvc\""
Jul 02 20:30:53.998280 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.998263    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"rate-test-model-c7f980-kserve-self-signed-certs\""
Jul 02 20:30:53.998559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.998324    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"openshift-service-ca.crt\""
Jul 02 20:30:53.998559 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:53.998370    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-c7f980\"/\"kube-root-ca.crt\""
Jul 02 20:30:54.005405 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.005380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"]
Jul 02 20:30:54.118681 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.118647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-dshm\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.118948 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.118688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-model-cache\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.118948 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.118768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tls-certs\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.118948 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.118848    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tmp-dir\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.118948 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.118927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-home\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.119164 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.118973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4twb6\" (UniqueName: \"kubernetes.io/projected/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-kube-api-access-4twb6\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220398 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tls-certs\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220580 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tmp-dir\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220580 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-home\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220580 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4twb6\" (UniqueName: \"kubernetes.io/projected/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-kube-api-access-4twb6\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220580 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220504    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-dshm\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220580 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-model-cache\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.220963 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220937    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tmp-dir\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.221015 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220977    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-model-cache\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.221015 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.220992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-home\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.222810 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.222787    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-dshm\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.223023 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.223003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tls-certs\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.228642 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.228619    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4twb6\" (UniqueName: \"kubernetes.io/projected/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-kube-api-access-4twb6\") pod \"rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") " pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.304588 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.304483    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:30:54.443443 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.443413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"]
Jul 02 20:30:54.446082 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:30:54.446055    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10ebd914_21e4_49a9_aaea_a5dea1fe65ac.slice/crio-5b8f511a4c8f52d14aaaada0f33876148069dc96ba17de95bb06749dee2878ab WatchSource:0}: Error finding container 5b8f511a4c8f52d14aaaada0f33876148069dc96ba17de95bb06749dee2878ab: Status 404 returned error can't find the container with id 5b8f511a4c8f52d14aaaada0f33876148069dc96ba17de95bb06749dee2878ab
Jul 02 20:30:54.569399 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.569295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw" event={"ID":"10ebd914-21e4-49a9-aaea-a5dea1fe65ac","Type":"ContainerStarted","Data":"f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f"}
Jul 02 20:30:54.569399 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.569336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw" event={"ID":"10ebd914-21e4-49a9-aaea-a5dea1fe65ac","Type":"ContainerStarted","Data":"5b8f511a4c8f52d14aaaada0f33876148069dc96ba17de95bb06749dee2878ab"}
Jul 02 20:30:54.586962 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:54.586903    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw" podStartSLOduration=1.586859384 podStartE2EDuration="1.586859384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:30:54.586588369 +0000 UTC m=+2398.881470959" watchObservedRunningTime="2026-07-02 20:30:54.586859384 +0000 UTC m=+2398.881741896"
Jul 02 20:30:58.189730 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:30:58.189694    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:31:04.305532 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:04.305483    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:31:04.305970 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:04.305542    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:31:04.318340 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:04.318306    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:31:04.629968 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:04.629869    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:31:11.891675 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:11.891639    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:31:26.192586 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:26.192494    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:31:33.938849 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:33.938799    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"]
Jul 02 20:31:34.892282 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:34.892245    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"]
Jul 02 20:31:41.095333 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:41.095293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:31:48.959738 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:48.959695    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5" podUID="0382b4aa-62f3-4727-98c8-f5ef829e4c47" containerName="main" containerID="cri-o://5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691" gracePeriod=45
Jul 02 20:31:49.220278 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.220217    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:31:49.249738 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.249702    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58rfj\" (UniqueName: \"kubernetes.io/projected/0382b4aa-62f3-4727-98c8-f5ef829e4c47-kube-api-access-58rfj\") pod \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") "
Jul 02 20:31:49.249921 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.249771    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-dshm\") pod \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") "
Jul 02 20:31:49.249921 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.249822    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-home\") pod \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") "
Jul 02 20:31:49.249921 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.249852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tls-certs\") pod \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") "
Jul 02 20:31:49.249921 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.249910    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-model-cache\") pod \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") "
Jul 02 20:31:49.250148 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.249963    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tmp-dir\") pod \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\" (UID: \"0382b4aa-62f3-4727-98c8-f5ef829e4c47\") "
Jul 02 20:31:49.250148 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.250112    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-home" (OuterVolumeSpecName: "home") pod "0382b4aa-62f3-4727-98c8-f5ef829e4c47" (UID: "0382b4aa-62f3-4727-98c8-f5ef829e4c47"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:49.250296 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.250235    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-model-cache" (OuterVolumeSpecName: "model-cache") pod "0382b4aa-62f3-4727-98c8-f5ef829e4c47" (UID: "0382b4aa-62f3-4727-98c8-f5ef829e4c47"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:49.250375 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.250296    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0382b4aa-62f3-4727-98c8-f5ef829e4c47" (UID: "0382b4aa-62f3-4727-98c8-f5ef829e4c47"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:49.250375 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.250347    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:49.252557 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.252527    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-dshm" (OuterVolumeSpecName: "dshm") pod "0382b4aa-62f3-4727-98c8-f5ef829e4c47" (UID: "0382b4aa-62f3-4727-98c8-f5ef829e4c47"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:49.252557 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.252533    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0382b4aa-62f3-4727-98c8-f5ef829e4c47" (UID: "0382b4aa-62f3-4727-98c8-f5ef829e4c47"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:31:49.252708 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.252571    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0382b4aa-62f3-4727-98c8-f5ef829e4c47-kube-api-access-58rfj" (OuterVolumeSpecName: "kube-api-access-58rfj") pod "0382b4aa-62f3-4727-98c8-f5ef829e4c47" (UID: "0382b4aa-62f3-4727-98c8-f5ef829e4c47"). InnerVolumeSpecName "kube-api-access-58rfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:31:49.351101 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.351063    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:49.351101 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.351096    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:49.351101 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.351107    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:49.351344 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.351116    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58rfj\" (UniqueName: \"kubernetes.io/projected/0382b4aa-62f3-4727-98c8-f5ef829e4c47-kube-api-access-58rfj\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:49.351344 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.351124    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0382b4aa-62f3-4727-98c8-f5ef829e4c47-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:49.841784 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.841752    2562 generic.go:356] "Generic (PLEG): container finished" podID="0382b4aa-62f3-4727-98c8-f5ef829e4c47" containerID="5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691" exitCode=0
Jul 02 20:31:49.841989 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.841795    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"
Jul 02 20:31:49.841989 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.841798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5" event={"ID":"0382b4aa-62f3-4727-98c8-f5ef829e4c47","Type":"ContainerDied","Data":"5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691"}
Jul 02 20:31:49.841989 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.841919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5" event={"ID":"0382b4aa-62f3-4727-98c8-f5ef829e4c47","Type":"ContainerDied","Data":"6832acbbbd6d4395f4b4e429ca9595c1fa984ecc0c7a7d8697d4e86a57a93125"}
Jul 02 20:31:49.841989 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.841942    2562 scope.go:117] "RemoveContainer" containerID="5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691"
Jul 02 20:31:49.851434 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.851414    2562 scope.go:117] "RemoveContainer" containerID="5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691"
Jul 02 20:31:49.851735 ip-10-0-143-37 kubenswrapper[2562]: E0702 20:31:49.851712    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691\": container with ID starting with 5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691 not found: ID does not exist" containerID="5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691"
Jul 02 20:31:49.851795 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.851743    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691"} err="failed to get container status \"5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691\": rpc error: code = NotFound desc = could not find container \"5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691\": container with ID starting with 5c474a142a346fe379b7de27d8f21fc3d9f898708ebb2833dfd21bbf4990c691 not found: ID does not exist"
Jul 02 20:31:49.862238 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.862206    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"]
Jul 02 20:31:49.864160 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.864137    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3136f3/rate-test-model-3136f3-kserve-848c54464c-p4ns5"]
Jul 02 20:31:49.912583 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:49.912549    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw" podUID="10ebd914-21e4-49a9-aaea-a5dea1fe65ac" containerName="main" containerID="cri-o://f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f" gracePeriod=45
Jul 02 20:31:50.170413 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.170385    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:31:50.259738 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.259701    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tls-certs\") pod \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") "
Jul 02 20:31:50.259985 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.259760    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-home\") pod \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") "
Jul 02 20:31:50.259985 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.259820    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4twb6\" (UniqueName: \"kubernetes.io/projected/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-kube-api-access-4twb6\") pod \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") "
Jul 02 20:31:50.259985 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.259850    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-model-cache\") pod \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") "
Jul 02 20:31:50.259985 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.259945    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-dshm\") pod \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") "
Jul 02 20:31:50.259985 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.259971    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tmp-dir\") pod \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\" (UID: \"10ebd914-21e4-49a9-aaea-a5dea1fe65ac\") "
Jul 02 20:31:50.260269 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.260152    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-home" (OuterVolumeSpecName: "home") pod "10ebd914-21e4-49a9-aaea-a5dea1fe65ac" (UID: "10ebd914-21e4-49a9-aaea-a5dea1fe65ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:50.260269 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.260190    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "10ebd914-21e4-49a9-aaea-a5dea1fe65ac" (UID: "10ebd914-21e4-49a9-aaea-a5dea1fe65ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:50.260378 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.260314    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-home\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:50.260378 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.260315    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "10ebd914-21e4-49a9-aaea-a5dea1fe65ac" (UID: "10ebd914-21e4-49a9-aaea-a5dea1fe65ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:50.260378 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.260330    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-model-cache\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:50.262057 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.262027    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "10ebd914-21e4-49a9-aaea-a5dea1fe65ac" (UID: "10ebd914-21e4-49a9-aaea-a5dea1fe65ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 02 20:31:50.262198 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.262104    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-dshm" (OuterVolumeSpecName: "dshm") pod "10ebd914-21e4-49a9-aaea-a5dea1fe65ac" (UID: "10ebd914-21e4-49a9-aaea-a5dea1fe65ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 02 20:31:50.262376 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.262359    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-kube-api-access-4twb6" (OuterVolumeSpecName: "kube-api-access-4twb6") pod "10ebd914-21e4-49a9-aaea-a5dea1fe65ac" (UID: "10ebd914-21e4-49a9-aaea-a5dea1fe65ac"). InnerVolumeSpecName "kube-api-access-4twb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 02 20:31:50.266557 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.266521    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0382b4aa-62f3-4727-98c8-f5ef829e4c47" path="/var/lib/kubelet/pods/0382b4aa-62f3-4727-98c8-f5ef829e4c47/volumes"
Jul 02 20:31:50.362445 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.362403    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4twb6\" (UniqueName: \"kubernetes.io/projected/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-kube-api-access-4twb6\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:50.362601 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.362512    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-dshm\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:50.362601 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.362529    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tmp-dir\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:50.362601 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.362538    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/10ebd914-21e4-49a9-aaea-a5dea1fe65ac-tls-certs\") on node \"ip-10-0-143-37.ec2.internal\" DevicePath \"\""
Jul 02 20:31:50.848400 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.848357    2562 generic.go:356] "Generic (PLEG): container finished" podID="10ebd914-21e4-49a9-aaea-a5dea1fe65ac" containerID="f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f" exitCode=0
Jul 02 20:31:50.848400 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.848407    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"
Jul 02 20:31:50.848645 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.848440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw" event={"ID":"10ebd914-21e4-49a9-aaea-a5dea1fe65ac","Type":"ContainerDied","Data":"f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f"}
Jul 02 20:31:50.848645 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.848485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw" event={"ID":"10ebd914-21e4-49a9-aaea-a5dea1fe65ac","Type":"ContainerDied","Data":"5b8f511a4c8f52d14aaaada0f33876148069dc96ba17de95bb06749dee2878ab"}
Jul 02 20:31:50.848645 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.848503    2562 scope.go:117] "RemoveContainer" containerID="f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f"
Jul 02 20:31:50.857321 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.857300    2562 scope.go:117] "RemoveContainer" containerID="f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f"
Jul 02 20:31:50.857602 ip-10-0-143-37 kubenswrapper[2562]: E0702 20:31:50.857584    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f\": container with ID starting with f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f not found: ID does not exist" containerID="f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f"
Jul 02 20:31:50.857646 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.857612    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f"} err="failed to get container status \"f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f\": rpc error: code = NotFound desc = could not find container \"f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f\": container with ID starting with f39c667438932b3c0d9fbcbdfbcb81b4b884ef29c3ef20379c37be529ed3728f not found: ID does not exist"
Jul 02 20:31:50.864396 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.864360    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"]
Jul 02 20:31:50.868083 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:50.868048    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-c7f980/rate-test-model-c7f980-kserve-6cdc9cc9b7-smxbw"]
Jul 02 20:31:52.264249 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:31:52.264203    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10ebd914-21e4-49a9-aaea-a5dea1fe65ac" path="/var/lib/kubelet/pods/10ebd914-21e4-49a9-aaea-a5dea1fe65ac/volumes"
Jul 02 20:32:12.188845 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:12.188810    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tltnw"]
Jul 02 20:32:21.534884 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:21.534855    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f_1946bf43-d4bb-4ed8-bac0-3f604e9e3efb/copy-manifests/0.log"
Jul 02 20:32:21.542254 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:21.542191    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f_1946bf43-d4bb-4ed8-bac0-3f604e9e3efb/manager/0.log"
Jul 02 20:32:23.402029 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:23.402001    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s26r7_1589b080-6386-4202-ae71-4e1b452dc8eb/manager/0.log"
Jul 02 20:32:23.523772 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:23.523750    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-98bg8_8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8/kuadrant-console-plugin/0.log"
Jul 02 20:32:23.894721 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:23.894690    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tltnw_e659cc6f-7e89-418c-9520-20e4c4ae531c/limitador/0.log"
Jul 02 20:32:24.706277 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:24.706248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-tqkw9_e26e7195-9b5d-4c01-90a8-b84ff196ad53/kube-auth-proxy/0.log"
Jul 02 20:32:25.902656 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:25.902625    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz5884_916f17c1-10c0-4296-822c-cd62c7886b59/main/0.log"
Jul 02 20:32:26.144012 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:26.143982    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-f9x6h_c03c3061-0594-4924-95b3-73631090339c/main/0.log"
Jul 02 20:32:33.887816 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:33.887786    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7j2wv_5d15d4cd-f8d6-4cbc-8169-d05382ce5729/global-pull-secret-syncer/0.log"
Jul 02 20:32:34.085849 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:34.085816    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ztxwh_23c9debd-909e-4b72-8963-a656e42f1b8b/konnectivity-agent/0.log"
Jul 02 20:32:34.153030 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:34.152939    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-37.ec2.internal_0e830bc32dc0970f441a153655ff8620/haproxy/0.log"
Jul 02 20:32:39.140333 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:39.140248    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-s26r7_1589b080-6386-4202-ae71-4e1b452dc8eb/manager/0.log"
Jul 02 20:32:39.189347 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:39.189312    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-98bg8_8e184b60-5aaf-4d7a-b747-5f8e61bc7ac8/kuadrant-console-plugin/0.log"
Jul 02 20:32:39.388224 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:39.388191    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tltnw_e659cc6f-7e89-418c-9520-20e4c4ae531c/limitador/0.log"
Jul 02 20:32:41.076619 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.076583    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/alertmanager/0.log"
Jul 02 20:32:41.097062 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.097032    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/config-reloader/0.log"
Jul 02 20:32:41.130146 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.130113    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/kube-rbac-proxy-web/0.log"
Jul 02 20:32:41.154368 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.154343    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/kube-rbac-proxy/0.log"
Jul 02 20:32:41.182895 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.182855    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/kube-rbac-proxy-metric/0.log"
Jul 02 20:32:41.203173 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.203148    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/prom-label-proxy/0.log"
Jul 02 20:32:41.229488 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.229461    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_63efd5bd-5e2b-4f41-b283-bc3da064db0a/init-config-reloader/0.log"
Jul 02 20:32:41.389024 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.388930    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8665f9f9d8-ptf42_3c71d76c-36d4-4102-aaf7-f2c332986222/metrics-server/0.log"
Jul 02 20:32:41.413912 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.413871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7rn54_98cdd854-b9f3-45d6-899a-639e7abe774b/monitoring-plugin/0.log"
Jul 02 20:32:41.519435 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.519409    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fs599_d7346a83-9ce2-48c1-bfdc-f6589fb61772/node-exporter/0.log"
Jul 02 20:32:41.543724 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.543701    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fs599_d7346a83-9ce2-48c1-bfdc-f6589fb61772/kube-rbac-proxy/0.log"
Jul 02 20:32:41.565024 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.564996    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fs599_d7346a83-9ce2-48c1-bfdc-f6589fb61772/init-textfile/0.log"
Jul 02 20:32:41.680443 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.680364    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4f44m_a343bf67-bcdb-4183-83df-1a19ee020cd7/kube-rbac-proxy-main/0.log"
Jul 02 20:32:41.701971 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.701944    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4f44m_a343bf67-bcdb-4183-83df-1a19ee020cd7/kube-rbac-proxy-self/0.log"
Jul 02 20:32:41.723835 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.723808    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-4f44m_a343bf67-bcdb-4183-83df-1a19ee020cd7/openshift-state-metrics/0.log"
Jul 02 20:32:41.775269 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.775244    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/prometheus/0.log"
Jul 02 20:32:41.797438 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.797410    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/config-reloader/0.log"
Jul 02 20:32:41.817346 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.817319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/thanos-sidecar/0.log"
Jul 02 20:32:41.840962 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.840937    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/kube-rbac-proxy-web/0.log"
Jul 02 20:32:41.872375 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.872349    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/kube-rbac-proxy/0.log"
Jul 02 20:32:41.893849 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.893824    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/kube-rbac-proxy-thanos/0.log"
Jul 02 20:32:41.917569 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.917548    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0d6b1fed-2304-4739-a744-d4cda2a5eb0d/init-config-reloader/0.log"
Jul 02 20:32:41.946058 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.945973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7jjck_602a21b0-4f28-4575-ae93-35b80f9456b7/prometheus-operator/0.log"
Jul 02 20:32:41.966511 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.966484    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-7jjck_602a21b0-4f28-4575-ae93-35b80f9456b7/kube-rbac-proxy/0.log"
Jul 02 20:32:41.992894 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:41.992846    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-zkz6c_1e8fea2f-35c8-4814-a6ba-d35d0372b5cf/prometheus-operator-admission-webhook/0.log"
Jul 02 20:32:44.566373 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566339    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"]
Jul 02 20:32:44.568600 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566714    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10ebd914-21e4-49a9-aaea-a5dea1fe65ac" containerName="main"
Jul 02 20:32:44.568600 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566724    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="10ebd914-21e4-49a9-aaea-a5dea1fe65ac" containerName="main"
Jul 02 20:32:44.568600 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566738    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0382b4aa-62f3-4727-98c8-f5ef829e4c47" containerName="main"
Jul 02 20:32:44.568600 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566743    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0382b4aa-62f3-4727-98c8-f5ef829e4c47" containerName="main"
Jul 02 20:32:44.568600 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566804    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0382b4aa-62f3-4727-98c8-f5ef829e4c47" containerName="main"
Jul 02 20:32:44.568600 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.566812    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="10ebd914-21e4-49a9-aaea-a5dea1fe65ac" containerName="main"
Jul 02 20:32:44.569567 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.569549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.571983 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.571957    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2l5b\"/\"openshift-service-ca.crt\""
Jul 02 20:32:44.572148 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.571959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-t2l5b\"/\"default-dockercfg-gf6wg\""
Jul 02 20:32:44.572148 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.571959    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-t2l5b\"/\"kube-root-ca.crt\""
Jul 02 20:32:44.580649 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.580620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"]
Jul 02 20:32:44.660145 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.660111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-sys\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.660330 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.660212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-proc\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.660330 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.660243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6hsl\" (UniqueName: \"kubernetes.io/projected/f20b8865-2171-4f31-90e2-7642c9bb6ba6-kube-api-access-r6hsl\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.660330 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.660267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-podres\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.660330 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.660300    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-lib-modules\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.707603 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.707571    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-5brg5_dbf9c758-f825-4cd7-a67a-c2a85b06f491/download-server/0.log"
Jul 02 20:32:44.761700 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761654    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-proc\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.761945 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6hsl\" (UniqueName: \"kubernetes.io/projected/f20b8865-2171-4f31-90e2-7642c9bb6ba6-kube-api-access-r6hsl\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.761945 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-podres\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.761945 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-lib-modules\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.761945 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-proc\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.761945 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-sys\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.762185 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761953    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-podres\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.762185 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761962    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-lib-modules\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.762185 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.761996    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f20b8865-2171-4f31-90e2-7642c9bb6ba6-sys\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.773278 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.773249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6hsl\" (UniqueName: \"kubernetes.io/projected/f20b8865-2171-4f31-90e2-7642c9bb6ba6-kube-api-access-r6hsl\") pod \"perf-node-gather-daemonset-qcdb5\" (UID: \"f20b8865-2171-4f31-90e2-7642c9bb6ba6\") " pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:44.880568 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:44.880476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:45.015853 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:45.015828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"]
Jul 02 20:32:45.018207 ip-10-0-143-37 kubenswrapper[2562]: W0702 20:32:45.018172    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf20b8865_2171_4f31_90e2_7642c9bb6ba6.slice/crio-c9c6d26c9a0d24625e98c21a61952104fb49eaba7641dae32b58679d1a39aca2 WatchSource:0}: Error finding container c9c6d26c9a0d24625e98c21a61952104fb49eaba7641dae32b58679d1a39aca2: Status 404 returned error can't find the container with id c9c6d26c9a0d24625e98c21a61952104fb49eaba7641dae32b58679d1a39aca2
Jul 02 20:32:45.110922 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:45.110867    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5" event={"ID":"f20b8865-2171-4f31-90e2-7642c9bb6ba6","Type":"ContainerStarted","Data":"c9c6d26c9a0d24625e98c21a61952104fb49eaba7641dae32b58679d1a39aca2"}
Jul 02 20:32:46.116798 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:46.116752    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5" event={"ID":"f20b8865-2171-4f31-90e2-7642c9bb6ba6","Type":"ContainerStarted","Data":"86d412c1697b8d77af698c7602205ff494c2d023f5ce52b5e9519e8e3fc00af9"}
Jul 02 20:32:46.117268 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:46.116827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:46.132590 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:46.132541    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5" podStartSLOduration=2.13252474 podStartE2EDuration="2.13252474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:32:46.131958419 +0000 UTC m=+2510.426840943" watchObservedRunningTime="2026-07-02 20:32:46.13252474 +0000 UTC m=+2510.427407253"
Jul 02 20:32:46.511339 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:46.511309    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-twpdr_c0af3202-a5d5-4e43-a9b6-60b7a0d22abc/dns/0.log"
Jul 02 20:32:46.534459 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:46.534433    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-twpdr_c0af3202-a5d5-4e43-a9b6-60b7a0d22abc/kube-rbac-proxy/0.log"
Jul 02 20:32:46.592693 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:46.592658    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsm22_1e52320f-3017-4db1-a6cc-43e306297148/dns-node-resolver/0.log"
Jul 02 20:32:47.146867 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:47.146828    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d8bc8c765-x6jnc_594c6682-42cf-4549-a216-3fe97fd2d801/registry/0.log"
Jul 02 20:32:47.216652 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:47.216624    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fcjwf_789a4b31-a62b-46cf-b64c-48a57fbedaac/node-ca/0.log"
Jul 02 20:32:48.275805 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:48.275728    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-tqkw9_e26e7195-9b5d-4c01-90a8-b84ff196ad53/kube-auth-proxy/0.log"
Jul 02 20:32:49.141324 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:49.141291    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sm6nq_f5eff5d8-623d-4712-855c-434fc2f17ce1/serve-healthcheck-canary/0.log"
Jul 02 20:32:49.654790 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:49.654761    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8prsh_b8bfd839-737e-4eec-8fc3-337109d446f2/kube-rbac-proxy/0.log"
Jul 02 20:32:49.675542 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:49.675515    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8prsh_b8bfd839-737e-4eec-8fc3-337109d446f2/exporter/0.log"
Jul 02 20:32:49.697644 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:49.697620    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8prsh_b8bfd839-737e-4eec-8fc3-337109d446f2/extractor/0.log"
Jul 02 20:32:52.131611 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:52.131583    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-t2l5b/perf-node-gather-daemonset-qcdb5"
Jul 02 20:32:52.317311 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:52.317279    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f_1946bf43-d4bb-4ed8-bac0-3f604e9e3efb/manager/0.log"
Jul 02 20:32:52.336125 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:52.336098    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6cc6b5b4c9-mmw5f_1946bf43-d4bb-4ed8-bac0-3f604e9e3efb/copy-manifests/0.log"
Jul 02 20:32:53.904651 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:53.904623    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fc9d97d57-jjtrj_47737ec4-ff1a-44d6-a16d-58d60110c22a/manager/0.log"
Jul 02 20:32:54.885886 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:54.885790    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-tqkw9_e26e7195-9b5d-4c01-90a8-b84ff196ad53/kube-auth-proxy/0.log"
Jul 02 20:32:56.295763 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:56.295729    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79ff5d7d55-tqkw9_e26e7195-9b5d-4c01-90a8-b84ff196ad53/kube-auth-proxy/0.log"
Jul 02 20:32:56.402448 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:32:56.402360    2562 scope.go:117] "RemoveContainer" containerID="1906ead73cd4a5ef2ba3df5cd8d119dcb9ad8ec2e2568a077299f68b66241ac7"
Jul 02 20:33:00.371083 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.371025    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6lj5l_bc8fd3be-7fd7-468f-80da-e8e62e9d8a7b/kube-multus/0.log"
Jul 02 20:33:00.428703 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.428674    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/kube-multus-additional-cni-plugins/0.log"
Jul 02 20:33:00.450283 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.450245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/egress-router-binary-copy/0.log"
Jul 02 20:33:00.470430 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.470403    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/cni-plugins/0.log"
Jul 02 20:33:00.490452 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.490425    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/bond-cni-plugin/0.log"
Jul 02 20:33:00.511820 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.511796    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/routeoverride-cni/0.log"
Jul 02 20:33:00.530782 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.530760    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/whereabouts-cni-bincopy/0.log"
Jul 02 20:33:00.550889 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.550840    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6mz57_da700b65-1646-4596-95d4-4d635686f180/whereabouts-cni/0.log"
Jul 02 20:33:00.963775 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.963692    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7vbkc_ae816d1e-f53b-43a4-a553-cc5651a184b2/network-metrics-daemon/0.log"
Jul 02 20:33:00.982448 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:00.982424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7vbkc_ae816d1e-f53b-43a4-a553-cc5651a184b2/kube-rbac-proxy/0.log"
Jul 02 20:33:01.839000 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.838967    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/ovn-controller/0.log"
Jul 02 20:33:01.858637 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.858603    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/ovn-acl-logging/0.log"
Jul 02 20:33:01.881433 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.881405    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/kube-rbac-proxy-node/0.log"
Jul 02 20:33:01.902009 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.901985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/kube-rbac-proxy-ovn-metrics/0.log"
Jul 02 20:33:01.920781 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.920753    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/northd/0.log"
Jul 02 20:33:01.944351 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.944315    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/nbdb/0.log"
Jul 02 20:33:01.964147 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:01.964122    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/sbdb/0.log"
Jul 02 20:33:02.011534 ip-10-0-143-37 kubenswrapper[2562]: I0702 20:33:02.011505    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9tm24_8e55f232-5890-4ccb-80ce-8d7a63893da2/ovnkube-controller/0.log"